ArticleEndocrine2020
Interobserver agreement and efficacy of consensus reading in Kwak-, EU-, and ACR-thyroid imaging recording and data systems and ATA guidelines for the ultrasound risk stratification of thyroid nodules.
Article in Endocrine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05982821 (A Multicenter Study of Artificial Intelligence-assisted Contrast-enhanced Ultrasound Diagnosis of Thyroid Nodules), which is not on this map. Cited by 26 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
A Multicenter Study of Artificial Intelligence-assisted Contrast-enhanced Ultrasound Diagnosis of Thyroid Nodules
Who cites it
26 citing papers in PubMed, 1 synthesis or guideline pooled it, 46 citations in OpenAlex.
- Systematic Review and Meta-Analysis of American College of Radiology TI-RADS Inter-Reader Reliability for Risk Stratification of Thyroid Nodules.Frontiers in oncology · 2022Pooled it
- Article
- Integrating Clinical Parameters into Thyroid Nodule Malignancy Risk: A Retrospective Evaluation Based on ACR TI-RADS.Journal of clinical medicine · 2025Article
- Interobserver Agreement in Ultrasound Risk Stratification Systems for Thyroid Nodules on Static Images Versus Cine-Loop Video Sequences.Diagnostics (Basel, Switzerland) · 2024Article
- Evaluation of the departmental inter-rater reliability when scoring thyroid nodules according to the British Thyroid Association Ultrasound-classification model: Is there significant disagreement?Ultrasound (Leeds, England) · 2024Article
- Thyroid Imaging Reporting and Data Systems: Applicability of the "Taller than Wide" Criterium in Primary/Secondary Care Units and the Role of Thyroid Scintigraphy.Journal of clinical medicine · 2024Article
- Thyroid Nodule Detection and Region Estimation in Ultrasound Images: A Comparison between Physicians and an Automated Decision Support System Approach.Diagnostics (Basel, Switzerland) · 2023Article
- Considerable interobserver variation calls for unambiguous definitions of thyroid nodule ultrasound characteristics.European thyroid journal · 2023Article
- The diagnostic efficacy and inappropriate biopsy rate of ACR TI-RADS and ATA guidelines for thyroid nodules in children and adolescents.Frontiers in endocrinology · 2023Article
- Repeatability of radiographic assessments for feline hip dysplasia suggest consensus scores in radiology are more uncertain than commonly assumed.Scientific reports · 2022Article
- Introducing a Pole Concept for Nodule Growth in the Thyroid Gland: Taller-than-Wide Shape, Frequency, Location and Risk of Malignancy of Thyroid Nodules in an Area with Iodine Deficiency.Journal of clinical medicine · 2022Article
- Summary of Meta-analyses of Studies Considering Lesion Size Cut-off Thresholds for The Assessment of Eligibility for FNAB and Sonoelastography and Inter- and Intra-observer Agreement in Estimating the Malignant Potential of Focal Lesions of The Thyroid Gland.Journal of ultrasonography · 2022Article
- Effect of training on resident inter-reader agreement with American College of Radiology Thyroid Imaging Reporting and Data System.World journal of radiology · 2022Article
- Shear Wave Elastography and Thyroid Imaging Reporting and Data System (TIRADS) for the Risk Stratification of Thyroid Nodules-Results of a Prospective Study.Diagnostics (Basel, Switzerland) · 2022Article
- The Diagnostic Efficacy of the American College of Radiology (ACR) Thyroid Imaging Report and Data System (TI-RADS) and the American Thyroid Association (ATA) Risk Stratification Systems for Thyroid Nodules.Computational and mathematical methods in medicine · 2022Article
- Article
- The New Era of TIRADSs to Stratify the Risk of Malignancy of Thyroid Nodules: Strengths, Weaknesses and Pitfalls.Cancers · 2021Review
- Prediction of thyroid nodule histopathology by expert ultrasound evaluation.Endocrine connections · 2021Article
- Ultrasound Cine Loop Standard Operating Procedure for Benign Thyroid Diseases-Evaluation of Non-Physician Application.Diagnostics (Basel, Switzerland) · 2021Article
- Is patient age associated with risk of malignancy in a ≥4 cm cytologically benign thyroid nodule?American journal of surgery · 2021Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors at 4 institutions in 1 country.
Funding
No grant is acknowledged in the PubMed record.
Abstract
purposeTo investigate the interobserver agreement (IA) and the impact of consensus reading using four risk stratification systems for thyroid nodules (TN).
methodsFour experienced specialists independently rated US images of 80 TN according to the Kwak-TIRADS, EU-TIRADS, ACR TI-RADS, and ATA Guidelines. The cases were randomly extracted from a prospectively acquired database (n > 1500 TN). The observers were blinded to clinical data. This study was divided into two sessions (S1 and S2) with 40 image sets each. After every session, a consensus reading was carried out (C1, C2). Subsequently, the effect of C1 was tested in S2 with 40 new cases followed by C2. Fleiss' kappa (κ) was calculated for S1 and S2 to estimate the IA and learning curves. The results of C1 and C2 were used as reference for diagnostic accuracy calculations.
resultsIA significantly increased (p < 0.01) after C1 with κ values of 0.375 (0.615), 0.411 (0.596), 0.321 (0.569), and 0.410 (0.583) for the Kwak-TIRADS, EU-TIRADS, ACR TI-RADS, and ATA Guidelines in S1 (S2), respectively. ROC analysis (C1 + C2) revealed similar areas under the curve (AUC) for the Kwak-TIRADS, EU-TIRADS, ACR TI-RADS, and ATA Guidelines (0.635, 0.675, 0.694, and 0.654, respectively, n.s.). AUC did not increase from C1 (0.677 ± 0.010) to C2 (0.632 ± 0.052, n.s.). ATA Guidelines were not applicable in five cases.
conclusionsIA and diagnostic accuracy were very similar for the four investigated risk stratification systems. Consensus reading sessions significantly improved the IA but did not affect the diagnostic accuracy.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.