Evidence map›Paper›PMID 35388010›Full record

ArticleNature communications2022

Accurate auto-labeling of chest X-ray images based on quantitative similarity to an explainable AI model.

Doyun Kim, Joowon Chung, Jongmun Choi, Marc D Succi, John Conklin, Maria Gabriela Figueiro Longo, Jeanne B Ackman, Brent P Little, Milena Petranovic, Mannudeep K Kalra and 2 more

Abstract read
In one paragraph

Article in Nature communications, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. [Explainable & Safe Artificial Intelligence in Radiology].Journal of the Korean Society of Radiology · 2024
    Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. A deep learning approach using an ensemble model to autocreate an image-based hip fracture registry.OTA international : the open access journal of orthopaedic trauma · 2023
    Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Doyun Kim *Department of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.
Joowon Chung *Department of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.ORCID 0000-0003-1572-8056
Jongmun ChoiDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.
Marc D SucciDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.
John ConklinDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.
Maria Gabriela Figueiro LongoDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.
Jeanne B AckmanDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.ORCID 0000-0001-5022-9530
Brent P LittleDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.
Milena PetranovicDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.
Mannudeep K KalraDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.ORCID 0000-0001-9938-7476
Michael H LevDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA.ORCID 0000-0003-0236-7319
Synho DoDepartment of Radiology, Massachusetts General Brigham and Harvard Medical School, Boston, MA, USA. sdo@mgh.harvard.edu.ORCID 0000-0001-6211-7050

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The inability to accurately, efficiently label large, open-access medical imaging datasets limits the widespread implementation of artificial intelligence models in healthcare. There have been few attempts, however, to automate the annotation of such public databases; one approach, for example, focused on labor-intensive, manual labeling of subsets of these datasets to be used to train new models. In this study, we describe a method for standardized, automated labeling based on similarity to a previously validated, explainable AI (xAI) model-derived-atlas, for which the user can specify a quantitative threshold for a desired level of accuracy (the probability-of-similarity, pSim metric). We show that our xAI model, by calculating the pSim values for each clinical output label based on comparison to its training-set derived reference atlas, can automatically label the external datasets to a user-selected, high level of accuracy, equaling or exceeding that of human experts. We additionally show that, by fine-tuning the original model using the automatically labelled exams for retraining, performance can be preserved or improved, resulting in a highly accurate, more generalized model.

Indexed as

Artificial IntelligenceThoraxDelivery of Health CareHumansRadiographyX-Rays

Identifiers

PMID35388010
PMCPMC8986787

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.