Evidence map›Paper›PMID 33727668›Full record

ArticleScientific reports2021

Critical evaluation of deep neural networks for wrist fracture detection.

Abu Mohammed Raisuddin, Elias Vaattovaara, Mika Nevalainen, Marko Nikki, Elina Järvenpää, Kaisa Makkonen, Pekka Pinola, Tuula Palsio, Arttu Niemensivu, Osmo Tervonen and 1 more

Abstract readEvaluation Study
In one paragraph

Article in Scientific reports, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Impact of deep learning on pediatric elbow fracture detection: a systematic review and meta-analysis.European journal of trauma and emergency surgery : official publication of the European Trauma Society · 2025
    Pooled it
  2. AI for detection, classification and prediction of loss of alignment of distal radius fractures; a systematic review.European journal of trauma and emergency surgery : official publication of the European Trauma Society · 2024
    Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Review
  7. Article
  8. Advances in Artificial Intelligence for Wrist Joint Injury Diagnosis.International journal of medical sciences · 2026
    Review
  9. Article
  10. Article
  11. Article
  12. Review
  13. A Computer Vision and Machine Learning Approach to Classify Views in Distal Radius Radiographs.Journal of orthopaedic research : official publication of the Orthopaedic Research Society · 2025
    Article
  14. Article
  15. Article
  16. Review
  17. Review
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Abu Mohammed Raisuddin *University of Oulu, Oulu, Finland. abu.raisuddin@oulu.fi.
Elias Vaattovaara *University of Oulu, Oulu, Finland.
Mika NevalainenUniversity of Oulu, Oulu, Finland.
Marko NikkiOulu University Hospital, Oulu, Finland.
Elina JärvenpääOulu University Hospital, Oulu, Finland.
Kaisa MakkonenOulu University Hospital, Oulu, Finland.
Pekka PinolaUniversity of Oulu, Oulu, Finland.
Tuula PalsioUniversity of Oulu, Oulu, Finland.
Arttu NiemensivuUniversity of Oulu, Oulu, Finland.
Osmo TervonenUniversity of Oulu, Oulu, Finland.
Aleksei TiulpinUniversity of Oulu, Oulu, Finland.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Wrist Fracture is the most common type of fracture with a high incidence rate. Conventional radiography (i.e. X-ray imaging) is used for wrist fracture detection routinely, but occasionally fracture delineation poses issues and an additional confirmation by computed tomography (CT) is needed for diagnosis. Recent advances in the field of Deep Learning (DL), a subfield of Artificial Intelligence (AI), have shown that wrist fracture detection can be automated using Convolutional Neural Networks. However, previous studies did not pay close attention to the difficult cases which can only be confirmed via CT imaging. In this study, we have developed and analyzed a state-of-the-art DL-based pipeline for wrist (distal radius) fracture detection-DeepWrist, and evaluated it against one general population test set, and one challenging test set comprising only cases requiring confirmation by CT. Our results reveal that a typical state-of-the-art approach, such as DeepWrist, while having a near-perfect performance on the general independent test set, has a substantially lower performance on the challenging test set-average precision of 0.99 (0.99-0.99) versus 0.64 (0.46-0.83), respectively. Similarly, the area under the ROC curve was of 0.99 (0.98-0.99) versus 0.84 (0.72-0.93), respectively. Our findings highlight the importance of a meticulous analysis of DL-based models before clinical use, and unearth the need for more challenging settings for testing medical AI systems.

Indexed as

Databases, FactualNeural Networks, ComputerTomography, X-Ray ComputedFemaleFractures, BoneHumansMaleRetrospective StudiesWristWrist Injuries

Identifiers

PMID33727668
PMCPMC7971048

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.