Evidence map›Paper›PMID 34561440›Full record

ArticleNature communications2021

Artificial intelligence system reduces false-positive findings in the interpretation of breast ultrasound exams.

Yiqiu Shen, Farah E Shamout, Jamie R Oliver, Jan Witowski, Kawshik Kannan, Jungkyu Park, Nan Wu, Connor Huddleston, Stacey Wolfson, Alexandra Millet and 19 more

Abstract read
In one paragraph

Article in Nature communications, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 125 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
125citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

125 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Artificial intelligence in bronchoscopy: a systematic review.European respiratory review : an official journal of the European Respiratory Society · 2025
    Pooled it
  4. Pooled it
  5. Trial
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

65 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

29 authors.

Yiqiu Shen *Center for Data Science, New York University, New York, NY, USA.ORCID http://orcid.org/0000-0002-7726-2514
Farah E Shamout *Engineering Division, NYU Abu Dhabi, Abu Dhabi, UAE.ORCID http://orcid.org/0000-0002-6076-725X
Jamie R Oliver *Department of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Jan WitowskiDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0001-9284-4830
Kawshik KannanDepartment of Computer Science, Courant Institute, New York University, New York, NY, USA.
Jungkyu ParkVilcek Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0001-5117-9651
Nan WuCenter for Data Science, New York University, New York, NY, USA.
Connor HuddlestonDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Stacey WolfsonDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Alexandra MilletDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Robin EhrenpreisDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Divya AwalDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Cathy TymaDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Naziya SamreenDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Yiming GaoDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Chloe ChhorDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Stacey GandhiDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Cindy LeeDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Sheila Kumari-SubaiyaDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Cindy LeonardDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Reyhan MohammedDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Christopher MoczulskiDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Jaime AltabetDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
James BabbDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Alana LewinDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Beatriu ReigDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0002-6577-8601
Linda MoyDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Laura HeacockDepartment of Radiology, NYU Grossman School of Medicine, New York, NY, USA.
Krzysztof J GerasCenter for Data Science, New York University, New York, NY, USA. k.j.geras@nyu.edu.ORCID http://orcid.org/0000-0003-0549-1446

Funding

TR&D 4: Revealing Microstructure: Biophysical modeling and validation for discovery and clinical careP41EB017183 · NIBIB · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI Hersh Chandarana · 2014 to 2026
$19.3M
Reducing recall rates of screening mammography with deep convolutional neural networkR21CA225175 · NCI · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI MOY, LINDA · 2018 to 2019
$395k
NCI NIH HHS R21 CA225175
6 · The paper itself

Abstract

Though consistently shown to detect mammographically occult cancers, breast ultrasound has been noted to have high false-positive rates. In this work, we present an AI system that achieves radiologist-level accuracy in identifying breast cancer in ultrasound images. Developed on 288,767 exams, consisting of 5,442,907 B-mode and Color Doppler images, the AI achieves an area under the receiver operating characteristic curve (AUROC) of 0.976 on a test set consisting of 44,755 exams. In a retrospective reader study, the AI achieves a higher AUROC than the average of ten board-certified breast radiologists (AUROC: 0.962 AI, 0.924 ± 0.02 radiologists). With the help of the AI, radiologists decrease their false positive rates by 37.3% and reduce requested biopsies by 27.8%, while maintaining the same level of sensitivity. This highlights the potential of AI in improving the accuracy, consistency, and efficiency of breast ultrasound diagnosis.

Indexed as

AlgorithmsArtificial IntelligenceEarly Detection of CancerAdultAgedBreastBreast NeoplasmsFemaleHumansMammographyMiddle AgedRadiologistsReproducibility of ResultsRetrospective StudiesROC CurveUltrasonography

Identifiers

PMID34561440
PMCPMC8463596

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.