Evidence map›Paper›PMID 39015174›Full record

ArticleFrontiers in endocrinology2024

Improving the diagnostic performance of inexperienced readers for thyroid nodules through digital self-learning and artificial intelligence assistance.

Si Eun Lee, Hye Jung Kim, Hae Kyoung Jung, Jing Hyang Jung, Jae-Han Jeon, Jin Hee Lee, Hanpyo Hong, Eun Jung Lee, Daham Kim, Jin Young Kwak

Erratum issuedAbstract read
In one paragraph

Article in Frontiers in endocrinology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

10 authors.

Si Eun LeeDepartment of Radiology, Yongin Severance Hospital, College of Medicine, Yonsei University, Yongin-si, Republic of Korea.
Hye Jung KimDepartment of Radiology, Kyungpook National University Chilgok Hospital, Daegu, Republic of Korea.
Hae Kyoung JungDepartment of Radiology, CHA University Bundang Medical Center, Seongnam-si, Republic of Korea.
Jing Hyang JungDepartment of Surgery, Kyungpook National University Chilgok Hospital, Daegu, Republic of Korea.
Jae-Han JeonDepartment of Endocrinology, Kyungpook National University Chilgok Hospital, Daegu, Republic of Korea.
Jin Hee LeeDepartment of Radiology, Keimyung University Dongsan Hospital, Daegu, Republic of Korea.
Hanpyo HongDepartment of Radiology, Yongin Severance Hospital, College of Medicine, Yonsei University, Yongin-si, Republic of Korea.
Eun Jung LeeDepartment of Computational Science and Engineering, Yonsei University, Seoul, Republic of Korea.
Daham KimDepartment of Endocrinology, College of Medicine, Yonsei University, Seoul, Republic of Korea.
Jin Young KwakDepartment of Radiology, College of Medicine, Yonsei University, Seoul, Republic of Korea.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Data-driven digital learning could improve the diagnostic performance of novice students for thyroid nodules. Objective: To evaluate the efficacy of digital self-learning and artificial intelligence-based computer-assisted diagnosis (AI-CAD) for inexperienced readers to diagnose thyroid nodules. Methods: Between February and August 2023, a total of 26 readers (less than 1 year of experience in thyroid US from various departments) from 6 hospitals participated in this study. Readers completed an online learning session comprising 3,000 thyroid nodules annotated as benign or malignant independently. They were asked to assess a test set consisting of 120 thyroid nodules with known surgical pathology before and after a learning session. Then, they referred to AI-CAD and made their final decisions on the thyroid nodules. Diagnostic performances before and after self-training and with AI-CAD assistance were evaluated and compared between radiology residents and readers from different specialties. Results: AUC (area under the receiver operating characteristic curve) improved after the self-learning session, and it improved further after radiologists referred to AI-CAD (0.679 vs 0.713 vs 0.758, p<0.05). Although the 18 radiology residents showed improved AUC (0.7 to 0.743, p=0.016) and accuracy (69.9% to 74.2%, p=0.013) after self-learning, the readers from other departments did not. With AI-CAD assistance, sensitivity (radiology 70.3% to 74.9%, others 67.9% to 82.3%, all p<0.05) and accuracy (radiology 74.2% to 77.1%, others 64.4% to 72.8%, all p <0.05) improved in all readers. Conclusion: While AI-CAD assistance helps improve the diagnostic performance of all inexperienced readers for thyroid nodules, self-learning was only effective for radiology residents with more background knowledge of ultrasonography. Clinical Impact: Online self-learning, along with AI-CAD assistance, can effectively enhance the diagnostic performance of radiology residents in thyroid cancer.

Indexed as

Artificial IntelligenceDiagnosis, Computer-AssistedThyroid NoduleAdultClinical CompetenceFemaleHumansInternship and ResidencyMaleMiddle AgedRadiologyROC CurveUltrasonographyartificial intelligencedigital learninglearningthyroid cancerultrasound

Identifiers

PMID39015174
PMCPMC11249553

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.