Evidence map›Paper›PMID 36175002›Full record

ArticleKorean journal of radiology2022

Artificial Intelligence-Based Identification of Normal Chest Radiographs: A Simulation Study in a Multicenter Health Screening Cohort.

Hyunsuk Yoo, Eun Young Kim, Hyungjin Kim, Ye Ra Choi, Moon Young Kim, Sung Ho Hwang, Young Joong Kim, Young Jun Cho, Kwang Nam Jin

Open access · hybridAbstract readMulticenter Study
In one paragraph

Article in Korean journal of radiology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed
3.2field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 22 citations in OpenAlex.

  1. Article
  2. Article
  3. The Effect of AI on the Radiologist Workforce: A Task-Based Analysis.medRxiv : the preprint server for health sciences · 2025
    Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Review
  9. Article
  10. Article
  11. Review
  12. Review
  13. Article
  14. Article
  15. Article
  16. Review
  17. Looking Back at 2022 and ahead to 2023 for theKorean journal of radiology · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 5 institutions in 1 country.

Hyunsuk Yoo *Lunit Inc, Seoul, Korea.ORCID 0000-0003-3255-7439
Eun Young Kim *Department of Radiology, Gil Medical Center, Gachon University College of Medicine, Incheon, Korea.ORCID 0000-0002-2101-7982
Hyungjin KimDepartment of Radiology, Seoul National University College of Medicine, Seoul National University Hospital, Seoul, Korea.ORCID 0000-0003-0722-0033
Ye Ra ChoiDepartment of Radiology, Seoul National University-Seoul Metropolitan Government Boramae Medical Center, Seoul, Korea.ORCID 0000-0002-2455-1718
Moon Young KimDepartment of Radiology, Seoul National University-Seoul Metropolitan Government Boramae Medical Center, Seoul, Korea.ORCID 0000-0003-3025-0409
Sung Ho HwangDepartment of Radiology, Korea University Anam Hospital, Seoul, Korea.ORCID 0000-0003-1850-0751
Young Joong KimDepartment of Radiology, Konyang University Hospital, Konyang University College of Medicine, Daejeon, Korea.ORCID 0000-0002-7084-0289
Young Jun ChoDepartment of Radiology, Konyang University Hospital, Konyang University College of Medicine, Daejeon, Korea.ORCID 0000-0002-0632-1011
Kwang Nam JinDepartment of Radiology, Seoul National University-Seoul Metropolitan Government Boramae Medical Center, Seoul, Korea. wlsrhkdska@gmail.com.ORCID 0000-0001-5494-9113
Seoul National University · KRKonyang University · KRSeoul National University Hospital · KRGachon University · KRKorea University Medical Center · KR

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThis study aimed to investigate the feasibility of using artificial intelligence (AI) to identify normal chest radiography (CXR) from the worklist of radiologists in a health-screening environment. MATERIALS AND

methodsThis retrospective simulation study was conducted using the CXRs of 5887 adults (mean age ± standard deviation, 55.4 ± 11.8 years; male, 4329) from three health screening centers in South Korea using a commercial AI (Lunit INSIGHT CXR3, version 3.5.8.8). Three board-certified thoracic radiologists reviewed CXR images for referable thoracic abnormalities and grouped the images into those with visible referable abnormalities (identified as abnormal by at least one reader) and those with clearly visible referable abnormalities (identified as abnormal by at least two readers). With AI-based simulated exclusion of normal CXR images, the percentages of normal images sorted and abnormal images erroneously removed were analyzed. Additionally, in a random subsample of 480 patients, the ability to identify visible referable abnormalities was compared among AI-unassisted reading (i.e., all images read by human readers without AI), AI-assisted reading (i.e., all images read by human readers with AI assistance as concurrent readers), and reading with AI triage (i.e., human reading of only those rendered abnormal by AI).

resultsOf 5887 CXR images, 405 (6.9%) and 227 (3.9%) contained visible and clearly visible abnormalities, respectively. With AI-based triage, 42.9% (2354/5482) of normal CXR images were removed at the cost of erroneous removal of 3.5% (14/405) and 1.8% (4/227) of CXR images with visible and clearly visible abnormalities, respectively. In the diagnostic performance study, AI triage removed 41.6% (188/452) of normal images from the worklist without missing visible abnormalities and increased the specificity for some readers without decreasing sensitivity.

conclusionThis study suggests the feasibility of sorting and removing normal CXRs using AI with a tailored cut-off to increase efficiency and reduce the workload of radiologists.

Indexed as

Artificial IntelligenceRadiologistsAdultCohort StudiesHumansMaleRetrospective StudiesTriageArtificial intelligenceChest radiographLung cancerNormal triageScreening

Identifiers

PMID36175002
PMCPMC9523233
OpenAlexW4298088040

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.