Evidence map›Paper›PMID 37878622›Full record

ArticlePloS one2023

Inter-rater reliability of a novel objective endpoint for benign central airway stenosis interventions: Segmentation-based volume rendering of computed tomography scans.

Ankush P Ratwani, Heidi Chen, Leah Brown, Evan A Schwartz, Khushbu Patel, Adam Guttentag, Thomas A McLaren, Kim L Sandler, Otis B Rickman, Samira Shojaee and 2 more

Open access · goldAbstract read
In one paragraph

Article in PloS one, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact, top 62% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 0 citations in OpenAlex.

  1. Review
  2. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 2 institutions in 1 country.

Ankush P RatwaniDepartment of Medicine, Division of Allergy, Pulmonary and Critical Care, Vanderbilt University Medical Center, Nashville, TN, United States of America.ORCID 0000-0003-0767-4748
Heidi ChenDepartment of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Leah BrownDepartment of Medicine, Division of Allergy, Pulmonary and Critical Care, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Evan A SchwartzDepartment of Medicine, Division of Pulmonary, Allergy and Critical Care Medicine, Duke University School of Medicine, Durham, NC, United States of America.
Khushbu PatelDepartment of Medicine, Division of Allergy, Pulmonary and Critical Care, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Adam GuttentagDepartment of Radiology and Radiological Science, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Thomas A McLarenDepartment of Radiology and Radiological Science, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Kim L SandlerDepartment of Radiology and Radiological Science, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Otis B RickmanDepartment of Medicine, Division of Allergy, Pulmonary and Critical Care, Vanderbilt University Medical Center, Nashville, TN, United States of America.ORCID 0000-0001-7222-6840
Samira ShojaeeDepartment of Medicine, Division of Allergy, Pulmonary and Critical Care, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Robert J LentzDepartment of Medicine, Division of Allergy, Pulmonary and Critical Care, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Fabien MaldonadoDepartment of Medicine, Division of Allergy, Pulmonary and Critical Care, Vanderbilt University Medical Center, Nashville, TN, United States of America.
Vanderbilt University Medical Center · USDuke University · US

Funding

Clinical and Translational Training Program in Pulmonary MedicineT32HL087738 · NHLBI · VANDERBILT UNIVERSITY MEDICAL CENTER · PI Lorraine B Ware · 2007 to 2026
$7.0M
NHLBI NIH HHS T32 HL087738
6 · The paper itself

Abstract

objectivesTo evaluate the reliability of a novel segmentation-based volume rendering approach for quantification of benign central airway obstruction (BCAO).

designA retrospective single-center cohort study.

settingData were ascertained using electronic health records at a tertiary academic medical center in the United States. PARTICIPANTS AND INCLUSION: Patients with airway stenosis located within the trachea on two-dimensional (2D) computed tomography (CT) imaging and documentation of suspected benign etiology were included. Four readers with varying expertise in quantifying tracheal stenosis severity were selected to manually segment each CT using a volume rendering approach with the available free tools in the medical imaging viewing software OsiriX (Bernex, Switzerland). Three expert thoracic radiologists were recruited to quantify the same CTs using traditional subjective methods on a continuous and categorical scale. OUTCOME MEASURES: The interrater reliability for continuous variables was calculated by the intraclass correlation coefficient (ICC) using a two-way mixed model with 95% confidence intervals (CI).

resultsThirty-eight patients met the inclusion criteria, and fifty CT scans were selected for measurement. The most common etiology of BCAO was iatrogenic in 22 patients (58%). There was an even distribution of chest and neck CT imaging within our cohort. The average ICC across all four readers for the volume rendering approach was 0.88 (95% CI, 0.84 to 0.93), suggesting good to excellent agreement. The average ICC for thoracic radiologists for subjective methods on the continuous scale was 0.38 (95% CI, 0.20 to 0.55), suggesting poor to fair agreement. The kappa for the categorical approach was 0.26, suggesting a slight to fair agreement amongst the raters.

conclusionIn this retrospective cohort study, agreement was good to excellent for raters with varying expertise in airway cross-sectional imaging using a novel segmentation-based volume rendering approach to quantify BCAO. This proposed measurement outperformed our expert thoracic radiologists using conventional subjective grading methods.

Indexed as

Tomography, X-Ray ComputedCohort StudiesConstriction, PathologicHumansObserver VariationReproducibility of ResultsRetrospective Studies

Identifiers

PMID37878622
PMCPMC10599541
OpenAlexW4387949671

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.