Evidence map›Paper›PMID 39401322›Full record

ArticleJournal of breast imaging2025

External Validation of a Commercial Artificial Intelligence Algorithm on a Diverse Population for Detection of False Negative Breast Cancers.

S Reed Plimpton, Hannah Milch, Christopher Sears, James Chalfant, Anne Hoyt, Cheryce Fischer, William Hsu, Melissa Joines

Abstract readValidation Study
In one paragraph

Article in Journal of breast imaging, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

S Reed PlimptonDepartment of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.
Hannah MilchDepartment of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.
Christopher SearsDepartment of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.
James ChalfantDepartment of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.ORCID 0000-0001-6385-604X
Anne HoytDepartment of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.
Cheryce FischerDepartment of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.
William HsuMedical & Imaging Informatics, Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.
Melissa JoinesDepartment of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.

Funding

Using artificial intelligence to support efficient same-day diagnostic imaging in breast cancer screeningR21HS029257 · AHRQ · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI HOYT, ANNE C, HSU, WILLIAM · 2022 to 2023
$273k
AHRQ HHS R21 HS029257AHRQ HHS R33 HS029257NIH HHS R21 HS029257
6 · The paper itself

Abstract

objectiveThere are limited data on the application of artificial intelligence (AI) on nonenriched, real-world screening mammograms. This work aims to evaluate the ability of AI to detect false negative cancers not detected at the time of screening when reviewed by the radiologist alone.

methodsA commercially available AI algorithm was retrospectively applied to patients undergoing screening full-field digital mammography (FFDM) or digital breast tomosynthesis (DBT) at a single institution from 2010 to 2019. Ground truth was established based on 1-year follow-up data. Descriptive statistics were performed with attention focused on AI detection of false negative cancers within these subsets.

resultsA total of 26 694 FFDM and 3183 DBT examinations were analyzed. Artificial intelligence was able to detect 7/13 false negative cancers (54%) in the FFDM cohort and 4/10 (40%) in the DBT cohort on the preceding screening mammogram that was interpreted as negative by the radiologist. Of these, 4 in the FFDM cohort and 4 in the DBT cohort were identified in breast densities of C or greater. False negative cancers detected by AI were predominantly luminal A invasive malignancies (9/11, 82%). Artificial intelligence was able to detect these false negative cancers a median time of 272 days sooner in the FFDM cohort and 248 days sooner in the DBT cohort compared to the radiologist.

conclusionArtificial intelligence was able to detect cancers at the time of screening that were missed by the radiologist. Prospective studies are needed to evaluate the synergy of AI and the radiologist in real-world settings, especially on DBT examinations.

Indexed as

AlgorithmsArtificial IntelligenceBreast NeoplasmsMammographyRadiographic Image Interpretation, Computer-AssistedAdultAgedBreastEarly Detection of CancerFalse Negative ReactionsFemaleHumansMiddle AgedRetrospective Studiesartificial intelligencebreast cancer screeningbreast imaging clinical operationsmammography including tomosynthesis

Identifiers

PMID39401322
PMCPMC11770225

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.