Evidence map›Paper›PMID 33123794›Full record

ArticleEuropean radiology2021

Variability in interpretation of low-dose chest CT using computerized assessment in a nationwide lung cancer screening program: comparison of prospective reading at individual institutions and retrospective central reading.

Eui Jin Hwang, Jin Mo Goo, Hyae Young Kim, Soon Ho Yoon, Gong Yong Jin, Jaeyoun Yi, Yeol Kim

Abstract read
PubMed Publisher
In one paragraph

Article in European radiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 2 pooled it
1.1field-weighted citation impact, top 18% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 2 syntheses or guidelines pooled it, 14 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Variability Among Radiologists in Interpreting Low-Dose CT Lung Cancer Screens.Journal of the American College of Radiology : JACR · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 3 institutions in 4 countries.

Eui Jin HwangDepartment of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
Jin Mo GooDepartment of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul, 03080, South Korea. jmgoo@plaza.snu.ac.kr.ORCID http://orcid.org/0000-0003-1791-7942
Hyae Young KimDepartment of Radiology, National Cancer Center, Goyang, South Korea.
Soon Ho YoonDepartment of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, 101 Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
Gong Yong JinDepartment of Radiology, Jeonbuk National University Hospital, Jeonju, South Korea.
Jaeyoun YiCoreline Soft Inc., Seoul, South Korea.
Yeol KimNational Cancer Control Institute, National Cancer Center, Goyang, South Korea.
Seoul National University · KRNational Cancer Center · KRJeonbuk National University Hospital · KR

Funding

National Healthy Promotion fund, Ministry of Health and Welfare 1760810-1National R&D Program for Cancer Control, Ministry of Health and Welfare 1520230
6 · The paper itself

Abstract

objectivesTo evaluate the degree of variability in computer-assisted interpretation of low-dose chest CTs (LDCTs) among radiologists in a nationwide lung cancer screening (LCS) program, through comparison with a retrospective interpretation from a central laboratory. MATERIALS AND

methodsConsecutive baseline LDCTs (n = 3353) from a nationwide LCS program were investigated. In the institutional reading, 20 radiologists in 14 institutions interpreted LDCTs using computer-aided detection and semi-automated segmentation systems for lung nodules. In the retrospective central review, a single radiologist re-interpreted all LDCTs using the same system, recording any non-calcified nodules ≥ 3 mm without arbitrary rejection of semi-automated segmentation to minimize the intervention of radiologist's discretion. Positive results (requiring additional follow-up LDCTs or diagnostic procedures) were initially classified by the lung CT screening reporting and data system (Lung-RADS) during the interpretation, while the classifications based on the volumetric criteria from the Dutch-Belgian lung cancer screening trial (NELSON) were retrospectively applied. Variabilities in positive rates were assessed with coefficients of variation (CVs).

resultsIn the institutional reading, positive rates by the Lung-RADS ranged from 7.5 to 43.3%, and those by the NELSON ranged from 11.4 to 45.0% across radiologists. The central review exhibited higher positive rates by Lung-RADS (20.0% vs. 27.3%; p < .001) and the NELSON (23.1% vs. 37.0%; p < .001), and lower inter-institution variability (CV, 0.30 vs. 0.12, p = .003 by Lung-RADS; CV, 0.25 vs. 0.12, p = .014 by the NELSON) compared to the institutional reading.

conclusionConsiderable inter-institution variability in the interpretation of LCS results is caused by different usage of the computer-assisted system. KEY POINTS: • Considerable variability existed in the interpretation of screening LDCT among radiologists partly from the different usage of the computerized system. • A retrospective reading of low-dose chest CTs in the central laboratory resulted in reduced variability but an increased positive rate.

Indexed as

Lung NeoplasmsBelgiumEarly Detection of CancerHumansProspective StudiesRadiographic Image Interpretation, Computer-AssistedReadingRetrospective StudiesTomography, X-Ray ComputedEarly detection of cancerImage interpretationLung neoplasmsTomography, X-Ray computed

Identifiers

PMID33123794
OpenAlexW3095687195

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.