Evidence map›Paper›PMID 33713172›Full record

SynthesisEuropean radiology2021

Inter-reader reliability of CT Liver Imaging Reporting and Data System according to imaging analysis methodology: a systematic review and meta-analysis.

Ji Hun Kang, Sang Hyun Choi, Ji Sung Lee, Kyung Won Kim, So Yeon Kim, Seung Soo Lee, Jae Ho Byun

Erratum issuedAbstract readMeta-AnalysisSystematic Review
PubMed Publisher
In one paragraph

Synthesis in European radiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 12 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

7 authors.

Ji Hun KangDepartment of Radiology, Hanyang University College of Medicine, Hanyang University Guri Hospital, Guri-si, Gyeonggi-do, Republic of Korea.
Sang Hyun ChoiDepartment of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Republic of Korea. edwardchoi83@gmail.com.ORCID http://orcid.org/0000-0002-6898-6617
Ji Sung LeeDepartment of Clinical Epidemiology and Biostatistics, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
Kyung Won KimDepartment of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Republic of Korea.
So Yeon KimDepartment of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Republic of Korea.
Seung Soo LeeDepartment of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Republic of Korea.
Jae Ho ByunDepartment of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Republic of Korea.

Funding

National Research Foundation of Korea NRF-2019R1G1A1099743
6 · The paper itself

Abstract

objectivesTo establish inter-reader reliability of CT Liver Imaging Reporting and Data System (LI-RADS) and explore factors that affect it.

methodsMEDLINE and EMBASE databases were searched from January 2014 to March 2020 to identify original articles reporting the inter-reader reliability of CT LI-RADS. The imaging analysis methodology of each study was identified, and pooled intraclass correlation coefficient (ICC) or kappa values (κ) were calculated for lesion size, major features (arterial-phase hyperenhancement [APHE], nonperipheral washout [WO], and enhancing capsule [EC]), and LI-RADS categorization (LR) using random-effects models. Subgroup analyses of pooled κ were performed for the number of readers, average reader experience, differences in reader experience, and LI-RADS version.

resultsIn the 12 included studies, the pooled ICC or κ of lesion size, APHE, WO, EC, and LR were 0.99 (0.96-1.00), 0.69 (0.58-0.81), 0.67 (0.53-0.82), 0.65 (0.54-0.76), and 0.70 (0.59-0.82), respectively. The experience and number of readers varied: studies using readers with ≥ 10 years of experience showed significantly higher κ for LR (0.82 vs. 0.45, p = 0.01) than those with < 10 years of reader experience. Studies with multiple readers including inexperienced readers showed significantly lower κ for APHE (0.55 vs. 0.76, p = 0.04) and LR (0.45 vs. 0.79, p = 0.02) than those with all experienced readers.

conclusionsCT LI-RADS showed substantial inter-reader reliability for major features and LR. Inter-reader reliability differed significantly according to average reader experience and differences in reader experience. Reported results for inter-reader reliability of CT LI-RADS should be understood with consideration of the imaging analysis methodology. KEY POINTS: • The CT Liver Imaging Reporting and Data System (LI-RADS) provides substantial inter-reader reliability for three major features and category assignment. • The imaging analysis methodology varied across studies. • The inter-reader reliability of CT LI-RADS differed significantly according to the average reader experience and the difference in reader experience.

Indexed as

Carcinoma, HepatocellularLiver NeoplasmsContrast MediaHumansMagnetic Resonance ImagingReproducibility of ResultsRetrospective StudiesTomography, X-Ray ComputedContrast MediaHepatocellular carcinomaLiverMeta-analysisMultidetector computed tomographyReproducibility of results

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.