Evidence map›Paper›PMID 37125409›Full record

ArticleJournal of medical imaging (Bellingham, Wash.)2023

Toward fairness in artificial intelligence for medical image analysis: identification and mitigation of potential biases in the roadmap from data collection to model deployment.

Karen Drukker, Weijie Chen, Judy Gichoya, Nicholas Gruszauskas, Jayashree Kalpathy-Cramer, Sanmi Koyejo, Kyle Myers, Rui C Sá, Berkman Sahiner, Heather Whitney and 2 more

Abstract read
In one paragraph

Article in Journal of medical imaging (Bellingham, Wash.), 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 51 papers.

0numbers the graph read from it
0cells of the map it votes in
51citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

51 citing papers in PubMed.

  1. Article
  2. Artificial intelligence in pediatric myopia - a narrative review.Graefe's archive for clinical and experimental ophthalmology = Albrecht von Graefes Archiv fur klinische und experimentelle Ophthalmologie · 2026
    Review
  3. Review
  4. Review
  5. Article
  6. Review
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Karen DrukkerThe University of Chicago, Department of Radiology, Chicago, Illinois, United States.ORCID https://orcid.org/0000-0001-6544-3476
Weijie ChenUS Food and Drug Administration, Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Silver Spring, Maryland, United States.
Judy GichoyaEmory University, Department of Radiology, Atlanta, Georgia, United States.ORCID https://orcid.org/0000-0002-1097-316X
Nicholas GruszauskasThe University of Chicago, Department of Radiology, Chicago, Illinois, United States.ORCID https://orcid.org/0000-0002-9667-7248
Jayashree Kalpathy-CramerUniversity of Colorado Anschutz, Department of Ophthalmology, Aurora, Colorado, United States.ORCID https://orcid.org/0000-0001-8906-9618
Sanmi KoyejoStanford University, Department of Computer Science, Stanford, California, United States.
Kyle MyersPuente Solutions LLC, Phoenix, Arizona, United States.ORCID https://orcid.org/0000-0001-7394-4932
Rui C SáNational Institutes of Health, Bethesda, Maryland, United States.ORCID https://orcid.org/0000-0002-8885-8671
Berkman SahinerUS Food and Drug Administration, Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, Silver Spring, Maryland, United States.
Heather WhitneyThe University of Chicago, Department of Radiology, Chicago, Illinois, United States.ORCID https://orcid.org/0000-0002-7258-1102
Zi ZhangJefferson Health, Philadelphia, Pennsylvania, United States.
Maryellen GigerThe University of Chicago, Department of Radiology, Chicago, Illinois, United States.ORCID https://orcid.org/0000-0001-5482-9728

Funding

RADX TECH - CERES NANOSCIENCE INC NANOTRAP PARTICLE MANUFACTURING75N92020C00021 · NHLBI · CERES NANOSCIENCES, LLLP · PI DUNLAP, ROSS · 2021 to 2021
$4.0M
NHLBI NIH HHS 75N92020C00008NHLBI NIH HHS 75N92020C00021
6 · The paper itself

Abstract

Purpose: To recognize and address various sources of bias essential for algorithmic fairness and trustworthiness and to contribute to a just and equitable deployment of AI in medical imaging, there is an increasing interest in developing medical imaging-based machine learning methods, also known as medical imaging artificial intelligence (AI), for the detection, diagnosis, prognosis, and risk assessment of disease with the goal of clinical implementation. These tools are intended to help improve traditional human decision-making in medical imaging. However, biases introduced in the steps toward clinical deployment may impede their intended function, potentially exacerbating inequities. Specifically, medical imaging AI can propagate or amplify biases introduced in the many steps from model inception to deployment, resulting in a systematic difference in the treatment of different groups. Approach: Our multi-institutional team included medical physicists, medical imaging artificial intelligence/machine learning (AI/ML) researchers, experts in AI/ML bias, statisticians, physicians, and scientists from regulatory bodies. We identified sources of bias in AI/ML, mitigation strategies for these biases, and developed recommendations for best practices in medical imaging AI/ML development. Results: Five main steps along the roadmap of medical imaging AI/ML were identified: (1) data collection, (2) data preparation and annotation, (3) model development, (4) model evaluation, and (5) model deployment. Within these steps, or bias categories, we identified 29 sources of potential bias, many of which can impact multiple steps, as well as mitigation strategies. Conclusions: Our findings provide a valuable resource to researchers, clinicians, and the public at large.

Indexed as

artificial intelligencebiasfairnessmachine learning

Identifiers

PMID37125409
PMCPMC10129875

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.