Evidence map›Paper›PMID 33884472›Full record

ArticleEuropean radiology2021

Effectiveness of radiologist training in improving reader agreement for Lung-RADS 4X categorization.

Hyungjin Kim, Jin Mo Goo, Tae Jung Kim, Hyae Young Kim, Guanmin Gu, Bomi Gil, Wooil Kim, Seon Young Park, Junghoan Park, Juil Park and 15 more

Abstract read
PubMed Publisher
In one paragraph

Article in European radiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
0.9field-weighted citation impact, top 26% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 9 citations in OpenAlex.

  1. Article
  2. Article
  3. Comparison of different classification systems for pulmonary nodules: a multicenter retrospective study in China.Cancer imaging : the official publication of the International Cancer Imaging Society · 2024
    Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

25 authors at 18 institutions in 4 countries.

Hyungjin KimDepartment of Radiology, Seoul National University College of Medicine, 101, Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
Jin Mo GooDepartment of Radiology, Seoul National University College of Medicine, 101, Daehak-ro, Jongno-gu, Seoul, 03080, South Korea. jmgoo@plaza.snu.ac.kr.ORCID http://orcid.org/0000-0003-1791-7942
Tae Jung KimSamsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, South Korea.
Hyae Young KimNational Cancer Center, Goyang, South Korea.
Guanmin GuPohang St. Mary's Hospital, Pohang, South Korea.
Bomi GilBucheon St. Mary's Hospital, The Catholic University of Korea, Seoul, South Korea.
Wooil KimAsan Medical Center, Seoul, South Korea.
Seon Young ParkDankook University Hospital, Cheonan, South Korea.
Junghoan ParkDepartment of Radiology, Seoul National University College of Medicine, 101, Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
Juil ParkDepartment of Radiology, Seoul National University College of Medicine, 101, Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
Harkhoon ParkDesign Hospital, Jeonju, South Korea.
Wonkyu SongJeonju Hospital, Jeonju, South Korea.
Kyung Eun ShinSoonChunHyang University Bucheon Hospital, Bucheon, South Korea.
Jiseon OhDepartment of Radiology, Seoul National University College of Medicine, 101, Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
Sung Hyun YoonSeoul National University Bundang Hospital, Seongnam, South Korea.
Sanghyup LeeLunit Inc., Seoul, South Korea.
Youkyung LeeHanyang University Guri Hospital, Guri, South Korea.
Woo Hyeon LimDepartment of Radiology, Seoul National University College of Medicine, 101, Daehak-ro, Jongno-gu, Seoul, 03080, South Korea.
Won Gi JeongChonnam National University Hwasun Hospital, Hwasun-gun, South Korea.
Jung Im JungSeoul St. Mary's Hospital, The Catholic University of Korea, Seoul, South Korea.
Min Jae ChaChung-Ang University Hospital, Seoul, South Korea.
Sinae ChoiWesarang Internal Medicine Clinic, Jeonju, South Korea.
Hyoung In ChoiKorean Armed Forces Capital Hospital, Seongnam, South Korea.
Soo-Youn HamSungkyunkwan University Kangbuk Samsung Hospital, Seoul, South Korea.
Yeol KimNational Cancer Center, Goyang, South Korea.
Seoul National University Hospital · KRSeoul National University · KRArmed Forces Capital Hospital · KRAsan Medical Center · KRBucheon University · KRCancer Research Institute · USChonnam National University Hwasun Hospital · KRChung-Ang University Hospital · KRDankook University Hospital · KRHanyang University Guri Hospital · KRJeonju University · KRKangbuk Samsung Hospital · KRMaeumsarang Hospital · KRNational Cancer Center · KRSamsung Medical Center · KRSeoul National University Bundang Hospital · KRThe Catholic University of Korea Bucheon St. Mary's Hospital · KRThe Catholic University of Korea Seoul St. Mary's Hospital · KR

Funding

Ministry of Health and Welfare 1520230Ministry of Health and Welfare 1720310Ministry of Health and Welfare 1760810-1
6 · The paper itself

Abstract

objectivesTo identify the agreement on Lung CT Screening Reporting and Data System 4X categorization between radiologists and an expert-adjudicated reference standard and to investigate whether training led to improvement of the agreement measures and diagnostic potential for lung cancer.

methodsCategory 4 nodules in the Korean Lung Cancer Screening Project were identified retrospectively, and each 4X nodule was matched with one 4A or 4B nodule. An expert panel re-evaluated the categories and determined the reference standard. Nineteen radiologists were asked to determine the presence of CT features of malignancy and 4X categorization for each nodule. A review was performed in two sessions, and training material was given after session 1. Agreement on 4X categorization between radiologists and the expert-adjudicated reference standard and agreement between radiologist-assessed 4X categorization and lung cancer diagnosis were evaluated.

resultsThe 48 expert-adjudicated 4X nodules and 64 non-4X nodules were evenly distributed in each session. The proportion of category 4X decreased after training (56.4% ± 16.9% vs. 33.4% ± 8.0%; p < 0.001). Cohen's κ indicated poor agreement (0.39 ± 0.16) in session 1, but agreement improved in session 2 (0.47 ± 0.09; p = 0.03). The increase in agreement in session 2 was observed among inexperienced radiologists (p < 0.05), and experienced and inexperienced reviewers exhibited comparable agreement performance in session 2 (p > 0.05). All agreement measures between radiologist-assessed 4X categorization and lung cancer diagnosis increased in session 2 (p < 0.05).

conclusionRadiologist training can improve reader agreement on 4X categorization, leading to enhanced diagnostic performance for lung cancer. KEY POINTS: • Agreement on 4X categorization between radiologists and an expert-adjudicated reference standard was initially poor, but improved significantly after training. • The mean proportion of 4X categorization by 19 radiologists decreased from 56.4% ± 16.9% in session 1 to 33.4% ± 8.0% in session 2. • All agreement measures between the 4X categorization and lung cancer diagnosis increased significantly in session 2, implying that appropriate training and guidance increased the diagnostic potential of category 4X.

Indexed as

Lung NeoplasmsEarly Detection of CancerHumansLungRadiologistsRetrospective StudiesTomography, X-Ray ComputedDiagnostic screening programsEarly detection of cancerLung neoplasmsMultidetector computed tomography

Identifiers

PMID33884472
OpenAlexW3155124540

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.