Evidence map›Paper›PMID 37758250›Full record

ArticleJournal of the National Cancer Institute2024

Artificial intelligence-based image analysis in clinical testing: lessons from cervical cancer screening.

Didem Egemen, Rebecca B Perkins, Li C Cheung, Brian Befano, Ana Cecilia Rodriguez, Kanan Desai, Andreanne Lemay, Syed Rakin Ahmed, Sameer Antani, Jose Jeronimo and 4 more

Abstract read
In one paragraph

Article in Journal of the National Cancer Institute, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed.

  1. Automated acquisition of explainable knowledge from unannotated colposcopic images for predicting the natural course of CIN2.International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics · 2026
    Article
  2. Review
  3. Review
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Review
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Review
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Didem EgemenDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.ORCID 0000-0001-5617-4585
Rebecca B PerkinsDepartment of Obstetrics and Gynecology, Boston Medical Center/Boston University School of Medicine, Boston, MA, USA.
Li C CheungDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.
Brian BefanoInformation Management Services Inc, Calverton, MD, USA.ORCID 0000-0003-3614-210X
Ana Cecilia RodriguezDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.
Kanan DesaiDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.
Andreanne LemayAthinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, MA, USA.
Syed Rakin AhmedAthinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, MA, USA.
Sameer AntaniNational Library of Medicine, National Institutes of Health, Bethesda, MD, USA.ORCID 0000-0002-0040-1387
Jose JeronimoDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.
Nicolas WentzensenDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.ORCID 0000-0003-1251-0836
Jayashree Kalpathy-CramerAthinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, MA, USA.
Silvia De SanjoseDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.
Mark SchiffmanDivision of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.ORCID 0000-0002-4625-2508

Funding

Cervical Cancer MoonshotZIACP010230 · NCI · DIVISION OF CANCER EPIDEMIOLOGY AND GENETICS · PI SCHIFFMAN, MARK · 2018 to 2025
$33.8M
Machine learning and artificial intelligence research for clinical medical image processingZIALM010018 · NLM · NATIONAL LIBRARY OF MEDICINE · PI ANTANI, SAMEER · 2021 to 2025
$9.0M
NIH HHS
6 · The paper itself

Abstract

Novel screening and diagnostic tests based on artificial intelligence (AI) image recognition algorithms are proliferating. Some initial reports claim outstanding accuracy followed by disappointing lack of confirmation, including our own early work on cervical screening. This is a presentation of lessons learned, organized as a conceptual step-by-step approach to bridge the gap between the creation of an AI algorithm and clinical efficacy. The first fundamental principle is specifying rigorously what the algorithm is designed to identify and what the test is intended to measure (eg, screening, diagnostic, or prognostic). Second, designing the AI algorithm to minimize the most clinically important errors. For example, many equivocal cervical images cannot yet be labeled because the borderline between cases and controls is blurred. To avoid a misclassified case-control dichotomy, we have isolated the equivocal cases and formally included an intermediate, indeterminate class (severity order of classes: case>indeterminate>control). The third principle is evaluating AI algorithms like any other test, using clinical epidemiologic criteria. Repeatability of the algorithm at the borderline, for indeterminate images, has proven extremely informative. Distinguishing between internal and external validation is also essential. Linking the AI algorithm results to clinical risk estimation is the fourth principle. Absolute risk (not relative) is the critical metric for translating a test result into clinical use. Finally, generating risk-based guidelines for clinical use that match local resources and priorities is the last principle in our approach. We are particularly interested in applications to lower-resource settings to address health disparities. We note that similar principles apply to other domains of AI-based image analysis for medical diagnostic testing.

Indexed as

Artificial IntelligenceUterine Cervical NeoplasmsAlgorithmsEarly Detection of CancerFemaleHumansImage Processing, Computer-Assisted

Identifiers

PMID37758250
PMCPMC10777665

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.