Evidence map›Paper›PMID 36201483›Full record

ArticlePloS one2022

Deep learning models for COVID-19 chest x-ray classification: Preventing shortcut learning using feature disentanglement.

Anusua Trivedi, Caleb Robinson, Marian Blazes, Anthony Ortiz, Jocelyn Desbiens, Sunil Gupta, Rahul Dodhia, Pavan K Bhatraju, W Conrad Liles, Jayashree Kalpathy-Cramer and 2 more

Open access · goldAbstract read
In one paragraph

Article in PloS one, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
2.3field-weighted citation impact, top 12% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it, 20 citations in OpenAlex.

  1. Pooled it
  2. Artificial Intelligence Research as a Continuous Clinical Service.Mayo Clinic proceedings. Digital health · 2026
    Review
  3. Article
  4. Article
  5. Review
  6. Review
  7. AI pitfalls and what not to do: mitigating bias in AI.The British journal of radiology · 2023
    Review
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors at 3 institutions in 1 country.

Anusua TrivediAI for Good Research Lab, Microsoft, Redmond, WA, United States of America.
Caleb RobinsonAI for Good Research Lab, Microsoft, Redmond, WA, United States of America.
Marian BlazesDepartment of Ophthalmology, University of Washington, Seattle, WA, United States of America.
Anthony OrtizAI for Good Research Lab, Microsoft, Redmond, WA, United States of America.
Jocelyn DesbiensIntelligent Retinal Imaging Systems, Pensacola, FL, United States of America.
Sunil GuptaIntelligent Retinal Imaging Systems, Pensacola, FL, United States of America.
Rahul DodhiaAI for Good Research Lab, Microsoft, Redmond, WA, United States of America.ORCID 0000-0003-3812-3906
Pavan K BhatrajuDepartment of Medicine and Sepsis Center of Research Excellence, University of Washington (SCORE-UW), Seattle, WA, United States of America.
W Conrad LilesDepartment of Medicine and Sepsis Center of Research Excellence, University of Washington (SCORE-UW), Seattle, WA, United States of America.
Jayashree Kalpathy-CramerNeuroscience, Massachusetts General Hospital, Boston, MA, United States of America.
Aaron Y LeeDepartment of Ophthalmology, University of Washington, Seattle, WA, United States of America.ORCID 0000-0002-7452-1648
Juan M Lavista FerresAI for Good Research Lab, Microsoft, Redmond, WA, United States of America.
Microsoft (United States) · USUniversity of Washington · USMassachusetts General Hospital · US

Funding

Epidemiology and clinical outcomes of diabetic macular edemaK23EY029246 · NEI · UNIVERSITY OF WASHINGTON · PI LEE, AARON · 2018 to 2022
$1.1M
The Assessment of Acute Kidney Injury Sub-phenotypes in the Intensive Care UnitK23DK116967 · NIDDK · UNIVERSITY OF WASHINGTON · PI BHATRAJU, PAVAN KUMAR · 2019 to 2023
$938k
NEI NIH HHS K23 EY029246NIDDK NIH HHS K23 DK116967
6 · The paper itself

Abstract

In response to the COVID-19 global pandemic, recent research has proposed creating deep learning based models that use chest radiographs (CXRs) in a variety of clinical tasks to help manage the crisis. However, the size of existing datasets of CXRs from COVID-19+ patients are relatively small, and researchers often pool CXR data from multiple sources, for example, using different x-ray machines in various patient populations under different clinical scenarios. Deep learning models trained on such datasets have been shown to overfit to erroneous features instead of learning pulmonary characteristics in a phenomenon known as shortcut learning. We propose adding feature disentanglement to the training process. This technique forces the models to identify pulmonary features from the images and penalizes them for learning features that can discriminate between the original datasets that the images come from. We find that models trained in this way indeed have better generalization performance on unseen data; in the best case we found that it improved AUC by 0.13 on held out data. We further find that this outperforms masking out non-lung parts of the CXRs and performing histogram equalization, both of which are recently proposed methods for removing biases in CXR datasets.

Indexed as

COVID-19Deep LearningHumansLungRadiography, ThoracicX-Rays

Identifiers

PMID36201483
PMCPMC9536609
OpenAlexW4302760599

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.