Evidence map›Paper›PMID 36523640›Full record

ArticleRadiology. Artificial intelligence2022

Visual Transformers and Convolutional Neural Networks for Disease Classification on Radiographs: A Comparison of Performance, Sample Efficiency, and Hidden Stratification.

Zachary R Murphy, Kesavan Venkatesh, Jeremias Sulam, Paul H Yi

Open access · greenAbstract read
In one paragraph

Article in Radiology. Artificial intelligence, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed, 3 pooled it
5.6field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed, 3 syntheses or guidelines pooled it, 40 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Review
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 1 institution in 1 country.

Zachary R MurphyDepartment of Anesthesiology, University of Michigan, Ann Arbor, Mich (Z.R.M.); Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, Md (K.V., J.S.); and University of Maryland Medical Intelligent Imaging (UM2ii) Center, Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland School of Medicine, 22 S Greene St, First Floor, Baltimore, MD 21201 (P.H.Y.).ORCID https://orcid.org/0000-0002-1527-9943
Kesavan VenkateshDepartment of Anesthesiology, University of Michigan, Ann Arbor, Mich (Z.R.M.); Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, Md (K.V., J.S.); and University of Maryland Medical Intelligent Imaging (UM2ii) Center, Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland School of Medicine, 22 S Greene St, First Floor, Baltimore, MD 21201 (P.H.Y.).ORCID 0000-0001-8153-0115
Jeremias SulamDepartment of Anesthesiology, University of Michigan, Ann Arbor, Mich (Z.R.M.); Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, Md (K.V., J.S.); and University of Maryland Medical Intelligent Imaging (UM2ii) Center, Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland School of Medicine, 22 S Greene St, First Floor, Baltimore, MD 21201 (P.H.Y.).ORCID 0000-0003-0946-1957
Paul H YiDepartment of Anesthesiology, University of Michigan, Ann Arbor, Mich (Z.R.M.); Department of Biomedical Engineering, Johns Hopkins University Whiting School of Engineering, Baltimore, Md (K.V., J.S.); and University of Maryland Medical Intelligent Imaging (UM2ii) Center, Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland School of Medicine, 22 S Greene St, First Floor, Baltimore, MD 21201 (P.H.Y.).ORCID 0000-0001-9433-8093
University of Maryland, Baltimore · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Purpose: To compare performance, sample efficiency, and hidden stratification of visual transformer (ViT) and convolutional neural network (CNN) architectures for diagnosis of disease on chest radiographs and extremity radiographs using transfer learning. Materials and Methods: In this HIPAA-compliant retrospective study, the authors fine-tuned data-efficient image transformers (DeiT) ViT and CNN classification models pretrained on ImageNet using the National Institutes of Health Chest X-ray 14 dataset (112 120 images) and MURA dataset (14 656 images) for thoracic disease and extremity abnormalities, respectively. Performance was assessed on internal test sets and 75 000 external chest radiographs (three datasets). The primary comparison was DeiT-B ViT vs DenseNet121 CNN; secondary comparisons included DeiT-Ti (Tiny), ResNet152, and EfficientNetB7. Sample efficiency was evaluated by training models on varying dataset sizes. Hidden stratification was evaluated by comparing prevalence of chest tubes in pneumothorax false-positive and false-negative predictions and specific abnormalities for MURA false-negative predictions. Results: DeiT-B weighted area under the receiver operating characteristic curve (wAUC) was slightly lower than that for DenseNet121 on chest radiograph (0.78 vs 0.79; Conclusion: Although DeiT models had lower wAUCs than CNNs for chest radiograph and extremity domains, the differences may be negligible in clinical practice. DeiT-B had sample efficiency similar to that of DenseNet121 and may be less susceptible to certain types of hidden stratification.

Indexed as

Computer-aided DiagnosisConvolutional Neural Network (CNN)Deep LearningFeature DetectionInformaticsMachine LearningNeural NetworksSkeletal-AppendicularSupervised LearningThorax

Identifiers

PMID36523640
PMCPMC9745440
OpenAlexW4296708724

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.