Evidence map›Paper›PMID 33937783›Full record

ArticleRadiology. Artificial intelligence2019

Challenges Related to Artificial Intelligence Research in Medical Imaging and the Importance of Image Analysis Competitions.

Luciano M Prevedello, Safwan S Halabi, George Shih, Carol C Wu, Marc D Kohli, Falgun H Chokshi, Bradley J Erickson, Jayashree Kalpathy-Cramer, Katherine P Andriole, Adam E Flanders

Open access · greenAbstract read
In one paragraph

Article in Radiology. Artificial intelligence, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 74 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
74citing papers in PubMed, 2 pooled it
12.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

74 citing papers in PubMed, 2 syntheses or guidelines pooled it, 163 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Review
  12. Digital neuropathology of neurodegenerative disorders: Foundations, research advances, and future directions.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2025
    Review
  13. Review
  14. Review
  15. Article
  16. A Pan-Organ Vision-Language Model for Generalizable 3D CT Representations.medRxiv : the preprint server for health sciences · 2025
    Article
  17. Article
  18. Review
  19. Article
  20. Review

14 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 6 institutions in 1 country.

Luciano M PrevedelloDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).ORCID 0000-0002-6768-6452
Safwan S HalabiDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).ORCID 0000-0003-1317-984X
George ShihDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).ORCID 0000-0002-8356-2011
Carol C WuDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).
Marc D KohliDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).
Falgun H ChokshiDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).ORCID 0000-0002-8476-9129
Bradley J EricksonDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).
Jayashree Kalpathy-CramerDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).ORCID 0000-0001-8906-9618
Katherine P AndrioleDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).
Adam E FlandersDepartment of Radiology, The Ohio State University Wexner Medical Center, 395 West 12th Ave, 4th Floor, Room 422, Columbus, OH 43210 (L.M.P.); Department of Radiology, Stanford University School of Medicine, Stanford, Calif (S.S.H.); Department of Radiology, Weill Cornell Medical College, New York, NY (G.S.); Department of Diagnostic Radiology, University of Texas-MD Anderson Cancer Center, Houston, Tex (C.C.W.); Department of Radiology and Biomedical Imaging, University of California-San Francisco, San Francisco, Calif (M.D.K.); Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Ga (F.H.C.); Department of Radiology, Mayo Clinic, Rochester, Minn (B.J.E.); Department of Radiology and Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, Mass (J.K.C.); Department of Radiology, Brigham and Women's Hospital, Massachusetts General Hospital and BWH Center for Clinical Data Science, Boston, Mass (K.P.A.); and Department of Radiology, Thomas Jefferson University Hospital, Philadelphia, Pa (A.E.F.).ORCID 0000-0002-4679-0787
Cornell University · USBrigham and Women's Hospital · USEmory University · USHarvard University · USThe University of Texas MD Anderson Cancer Center · USUniversity of California, San Francisco · US

Funding

Quantitative Image Informatics for Cancer Research (QIICR)U24CA180918 · NCI · BRIGHAM AND WOMEN'S HOSPITAL · PI FEDOROV, ANDRIY, KIKINIS, RON · 2013 to 2017
$4.0M
Informatics Tools for Optimized Imaging Biomarkers for Cancer Research&DiscoveryU24CA180927 · NCI · MASSACHUSETTS GENERAL HOSPITAL · PI KALPATHY-CRAMER, JAYASHREE, ROSEN, BRUCE R · 2014 to 2018
$3.4M
Quantitative MRI of Glioblastoma ResponseU01CA154601 · NCI · MASSACHUSETTS GENERAL HOSPITAL · PI KALPATHY-CRAMER, JAYASHREE · 2011 to 2016
$3.4M
NCI NIH HHS U01 CA154601NCI NIH HHS U24 CA180918NCI NIH HHS U24 CA180927
6 · The paper itself

Abstract

In recent years, there has been enormous interest in applying artificial intelligence (AI) to radiology. Although some of this interest may have been driven by exaggerated expectations that the technology can outperform radiologists in some tasks, there is a growing body of evidence that illustrates its limitations in medical imaging. The true potential of the technique probably lies somewhere in the middle, and AI will ultimately play a key role in medical imaging in the future. The limitless power of computers makes AI an ideal candidate to provide the standardization, consistency, and dependability needed to support radiologists in their mission to provide excellent patient care. However, important roadblocks currently limit the expansion of this field in medical imaging. This article reviews some of the challenges and potential solutions to advance the field forward, with focus on the experience gained by hosting image-based competitions.

Identifiers

PMID33937783
PMCPMC8017381
OpenAlexW2911436281

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.