Evidence map›Paper›PMID 27570583›Full record

ArticleJournal of radiation oncology2016

Quantitative assessment of target delineation variability for thymic cancers: Agreement evaluation of a prospective segmentation challenge.

Emma Holliday, Clifton D Fuller, Jayashree Kalpathy-Cramer, Daniel Gomez, Andreas Rimner, Ying Li, Suresh Senan, Lynn D Wilson, Jehee Choi, Ritsuko Komaki and 1 more

Abstract read
In one paragraph

Article in Journal of radiation oncology, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. AnClinical and translational radiation oncology · 2019
    Article
  3. A dose based approach for evaluation of inter-observer variations in target delineation.Technical innovations & patient support in radiation oncology
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Emma HollidayDivision of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas.
Clifton D FullerDivision of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas.
Jayashree Kalpathy-CramerDepartment of Radiology, Massachusetts General Hospital, Boston, MA.
Daniel GomezDivision of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas.
Andreas RimnerDepartment of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY.
Ying LiDepartment of Radiation Oncology, The University of Texas Health Science Center San Antonio, San Antonio, TX.
Suresh SenanDepartment of Radiation Oncology, University Medical Center, Amsterdam, The Netherlands.
Lynn D WilsonDepartment of Therapeutic Radiology, Yale Cancer Center, New Haven, CT.
Jehee ChoiDepartment of Radiation Oncology, Kaiser Permanente Southern California, Los Angeles, CA.
Ritsuko KomakiDivision of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas.
Charles R ThomasDepartment of Radiation Medicine, Oregon Health and Science University Knight Cancer Center, Portland, OR.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
Paul Calabresi Clinical Oncology AwardK12CA088084 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI David S. Hong, Scott Kopetz · 2000 to 2026
$14.0M
Quantitative MRI of Glioblastoma ResponseU01CA154601 · NCI · MASSACHUSETTS GENERAL HOSPITAL · PI KALPATHY-CRAMER, JAYASHREE · 2011 to 2016
$3.4M
NCI NIH HHS K12 CA088084NCI NIH HHS L30 CA136381NCI NIH HHS P30 CA008748NCI NIH HHS U01 CA154601
6 · The paper itself

Abstract

objectivesWe sought to quantitatively determine the inter-observer variability of expert radiotherapy target-volume delineation for thymic cancers, as part of a larger effort to develop an expert-consensus contouring atlas.

methodsA pilot dataset was created consisting of a standardized case presentation with pre- and post-operative DICOM CT image sets from a single patient with Masaoka-Koga Stage III thymoma. Expert thoracic radiation oncologists delineated tumor targets on the pre- and post-operative scans as they would for a definitive and adjuvant case, respectively. Respondents completed a survey including recommended dose prescription and target volume margins for definitive and post-operative scenarios. Inter-observer variability was analyzed quantitatively with Warfield's simultaneous truth, performance level estimation (STAPLE) algorithm and Dice similarity coefficient (DSC).

resultsSeven users completed contouring for definitive and adjuvant cases; of these, 5 completed online surveys. Segmentation performance was assessed, with high mean±SD STAPLE-estimated segmentation sensitivity for definitive case GTV and CTV at 0.77 and 0.80, respectively, and post-operative CTV sensitivity of 0.55; all volumes had specificity of ≥0.99. Inter-observer agreement was markedly higher for the definitive target volumes, with mean±SD DSC of 0.88±0.03 and 0.89±0.04 for GTV and CTV respectively, compared to post-op CTV DSC of 0.69±0.06 (Kruskal-Wallis p<0.01.

conclusionExpert agreement for definitive case volumes was exceptionally high, though significantly lower agreement was noted post-operatively. Technique and dose prescription between experts was substantively consistent, and these preliminary results will be utilized to create an expert-consensus contouring atlas to aid the non-expert radiation oncologist in the planning of these challenging, rare tumors.

Indexed as

consensus guidelinesRadiotherapytarget delineationthymic carcinomathymomatreatment planning

Identifiers

PMID27570583
PMCPMC4996619

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.