Evidence map›Paper›PMID 38471396›Full record

ArticleEBioMedicine2024

Drop the shortcuts: image augmentation improves fairness and decreases AI detection of race and other demographics from medical images.

Ryan Wang, Po-Chih Kuo, Li-Ching Chen, Kenneth Patrick Seastedt, Judy Wawira Gichoya, Leo Anthony Celi

Open access · goldAbstract read
In one paragraph

Article in EBioMedicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
2.4field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 20 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Review
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 4 institutions in 2 countries.

Ryan WangDepartment of Computer Science, National Tsing Hua University, Hsinchu, Taiwan.
Po-Chih KuoDepartment of Computer Science, National Tsing Hua University, Hsinchu, Taiwan. Electronic address: kuopc@cs.nthu.edu.tw.
Li-Ching ChenDepartment of Computer Science, National Tsing Hua University, Hsinchu, Taiwan.
Kenneth Patrick SeastedtDepartment of Surgery, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA; Department of Thoracic Surgery, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA.
Judy Wawira GichoyaDepartment of Radiology, Emory University, Atlanta, GA, USA.
Leo Anthony CeliLaboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA; Division of Pulmonary Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA; Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA.
National Tsing Hua University · TWBeth Israel Deaconess Medical Center · USEmory University · USRoswell Park Comprehensive Cancer Center · US

Funding

Alzheimer's Disease Neuroimaging Initiative - SupplementU01AG024904 · NIA · NORTHERN CALIFORNIA INSTITUTE RES &EDUC · PI WEINER, MICHAEL W · 2004 to 2015
$121.0M
Bridge2AI: Patient-Focused Collaborative Hospital Repository Uniting Standards (CHoRUS) for Equitable AIOT2OD032701 · OD · MASSACHUSETTS GENERAL HOSPITAL · PI BIHORAC, AZRA, CLERMONT, GILLES · 2022 to 2025
$24.6M
MUST Data Science Research Hub (MUDSReH) - Democratized Trusted Research Environment (dTRE)U54TW012043 · FIC · MBARARA UNIVERSITY/SCIENCE/ TECHNOLOGY · PI Leo Anthony G Celi, Jessica Elizabeth Haberer · 2021 to 2026
$6.9M
RADX TECH - CERES NANOSCIENCE INC NANOTRAP PARTICLE MANUFACTURING75N92020C00021 · NHLBI · CERES NANOSCIENCES, LLLP · PI DUNLAP, ROSS · 2021 to 2021
$4.0M
Critical Care Informatics: Ethical considerations around the use and sharing of health-related dataR01EB017205 · NIBIB · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI CELI, LEO ANTHONY G, MARK, ROGER GREENWOOD · 2014 to 2021
$3.8M
FIC NIH HHS U54 TW012043NHLBI NIH HHS 75N92020C00008NHLBI NIH HHS 75N92020C00021NIA NIH HHS U01 AG024904NIBIB NIH HHS R01 EB017205NIH HHS OT2 OD032701
6 · The paper itself

Abstract

backgroundIt has been shown that AI models can learn race on medical images, leading to algorithmic bias. Our aim in this study was to enhance the fairness of medical image models by eliminating bias related to race, age, and sex. We hypothesise models may be learning demographics via shortcut learning and combat this using image augmentation.

methodsThis study included 44,953 patients who identified as Asian, Black, or White (mean age, 60.68 years ±18.21; 23,499 women) for a total of 194,359 chest X-rays (CXRs) from MIMIC-CXR database. The included CheXpert images comprised 45,095 patients (mean age 63.10 years ±18.14; 20,437 women) for a total of 134,300 CXRs were used for external validation. We also collected 1195 3D brain magnetic resonance imaging (MRI) data from the ADNI database, which included 273 participants with an average age of 76.97 years ±14.22, and 142 females. DL models were trained on either non-augmented or augmented images and assessed using disparity metrics. The features learned by the models were analysed using task transfer experiments and model visualisation techniques.

findingsIn the detection of radiological findings, training a model using augmented CXR images was shown to reduce disparities in error rate among racial groups (-5.45%), age groups (-13.94%), and sex (-22.22%). For AD detection, the model trained with augmented MRI images was shown 53.11% and 31.01% reduction of disparities in error rate among age and sex groups, respectively. Image augmentation led to a reduction in the model's ability to identify demographic attributes and resulted in the model trained for clinical purposes incorporating fewer demographic features.

interpretationThe model trained using the augmented images was less likely to be influenced by demographic information in detecting image labels. These results demonstrate that the proposed augmentation scheme could enhance the fairness of interpretations by DL models when dealing with data from patients with different demographic backgrounds.

fundingNational Science and Technology Council (Taiwan), National Institutes of Health.

Indexed as

BenchmarkingLearningAgedAsian PeopleBlack or African AmericanBlack PeopleBrainDemographyFemaleHumansMaleMiddle AgedUnited StatesWhite PeopleAugmentationBias mitigationDeep learningFairnessShortcuts

Identifiers

PMID38471396
PMCPMC10945176
OpenAlexW4392672760

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.