Evidence map›Paper›PMID 31748854›Full record

ArticleEuropean radiology2020

Deep learning-based detection system for multiclass lesions on chest radiographs: comparison with observer readings.

Sohee Park, Sang Min Lee, Kyung Hee Lee, Kyu-Hwan Jung, Woong Bae, Jooae Choe, Joon Beom Seo

Abstract read
PubMed Publisher
In one paragraph

Article in European radiology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 43 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
43citing papers in PubMed, 2 pooled it
6.7field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

43 citing papers in PubMed, 2 syntheses or guidelines pooled it, 77 citations in OpenAlex.

  1. Deep learning for pneumothorax diagnosis: a systematic review and meta-analysis.European respiratory review : an official journal of the European Respiratory Society · 2023
    Pooled it
  2. Prevalence of abnormal cardiovascular magnetic resonance findings in recovered patients from COVID-19: a systematic review and meta-analysis.Journal of cardiovascular magnetic resonance : official journal of the Society for Cardiovascular Magnetic Resonance · 2021
    Pooled it
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Review
  19. Article
  20. The rise of artificial intelligence reading of chest X-rays for enhanced TB diagnosis and elimination.The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 2 institutions in 1 country.

Sohee ParkDepartment of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, South Korea.
Sang Min LeeDepartment of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, South Korea. sangmin.lee.md@gmail.com.ORCID http://orcid.org/0000-0001-7627-2000
Kyung Hee LeeDepartment of Radiology, Seoul National University Bundang Hospital, Seoul National University College of Medicine, 300 Gumi-dong, Bundang-gu, Seongnam-si, Gyeonggi-do, 13620, South Korea. kyung8404@gmail.com.
Kyu-Hwan JungVUNO Inc., 736-8 Banpo-dong, Seocho-gu, Seoul, South Korea.
Woong BaeVUNO Inc., 736-8 Banpo-dong, Seocho-gu, Seoul, South Korea.
Jooae ChoeDepartment of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, South Korea.
Joon Beom SeoDepartment of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, South Korea.
Ulsan College · KRSeoul National University Bundang Hospital · KR

Funding

Ministry of Trade Industry and Energy 10072064
6 · The paper itself

Abstract

objectiveTo investigate the feasibility of a deep learning-based detection (DLD) system for multiclass lesions on chest radiograph, in comparison with observers.

methodsA total of 15,809 chest radiographs were collected from two tertiary hospitals (7204 normal and 8605 abnormal with nodule/mass, interstitial opacity, pleural effusion, or pneumothorax). Except for the test set (100 normal and 100 abnormal (nodule/mass, 70; interstitial opacity, 10; pleural effusion, 10; pneumothorax, 10)), radiographs were used to develop a DLD system for detecting multiclass lesions. The diagnostic performance of the developed model and that of nine observers with varying experiences were evaluated and compared using area under the receiver operating characteristic curve (AUROC), on a per-image basis, and jackknife alternative free-response receiver operating characteristic figure of merit (FOM) on a per-lesion basis. The false-positive fraction was also calculated.

resultsCompared with the group-averaged observations, the DLD system demonstrated significantly higher performances on image-wise normal/abnormal classification and lesion-wise detection with pattern classification (AUROC, 0.985 vs. 0.958; p = 0.001; FOM, 0.962 vs. 0.886; p < 0.001). In lesion-wise detection, the DLD system outperformed all nine observers. In the subgroup analysis, the DLD system exhibited consistently better performance for both nodule/mass (FOM, 0.913 vs. 0.847; p < 0.001) and the other three abnormal classes (FOM, 0.995 vs. 0.843; p < 0.001). The false-positive fraction of all abnormalities was 0.11 for the DLD system and 0.19 for the observers.

conclusionsThe DLD system showed the potential for detection of lesions and pattern classification on chest radiographs, performing normal/abnormal classifications and achieving high diagnostic performance. KEY POINTS: • The DLD system was feasible for detection with pattern classification of multiclass lesions on chest radiograph. • The DLD system had high performance of image-wise classification as normal or abnormal chest radiographs (AUROC, 0.985) and showed especially high specificity (99.0%). • In lesion-wise detection of multiclass lesions, the DLD system outperformed all 9 observers (FOM, 0.962 vs. 0.886; p < 0.001).

Indexed as

Deep LearningAdultAgedArea Under CurveFemaleHumansLung DiseasesLung Diseases, InterstitialLung NeoplasmsMaleMiddle AgedPleural DiseasesPleural EffusionPneumothoraxRadiographyRadiography, ThoracicAutomated pattern recognitionClassificationDeep learningThoracic radiography

Identifiers

PMID31748854
OpenAlexW2989639981

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.