Evidence map›Paper›PMID 25199768›Full record

Observational studyRadiation oncology (London, England)2014

Inter-observer variability of clinical target volume delineation in radiotherapy treatment of pancreatic cancer: a multi-institutional contouring experience.

Luciana Caravatta, Gabriella Macchia, Gian Carlo Mattiucci, Aldo Sainato, Nunzia L V Cernusco, Giovanna Mantello, Monica Di Tommaso, Marianna Trignani, Antonino De Paoli, Gianni Boz and 5 more

Abstract readMulticenter StudyObservational Study
In one paragraph

Observational study in Radiation oncology (London, England), 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed.

  1. Trial
  2. Trial
  3. Review
  4. Article
  5. Article
  6. Article
  7. Deep learning for autosegmentation for radiotherapy treatment planning: State-of-the-art and novel perspectives.Strahlentherapie und Onkologie : Organ der Deutschen Rontgengesellschaft ... [et al] · 2025
    Review
  8. Article
  9. Contouring aid tools in radiotherapy. Smoothing: the false friend.Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico · 2024
    Article
  10. Article
  11. Article
  12. Analysis of Radiation Therapy Quality Assurance in NRG Oncology RTOG 0848.International journal of radiation oncology, biology, physics · 2024
    Article
  13. Article
  14. Article
  15. Comparison of postmortem whole-body contrast-enhanced microfocus computed tomography and high-field magnetic resonance imaging of human fetuses.Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology · 2022
    Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Luciana CaravattaRadiation Oncology Department, "San Francesco" Hospital, Via Mannironi, 1, 08110 Nuoro, Italy. lcaravatta@hotmail.com.
Gabriella Macchia
Gian Carlo Mattiucci
Aldo Sainato
Nunzia L V Cernusco
Giovanna Mantello
Monica Di Tommaso
Marianna Trignani
Antonino De Paoli
Gianni Boz
Maria L Friso
Vincenzo Fusco
Marta Di Nicola
Alessio G Morganti
Domenico Genovesi

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAn observational multi-institutional study has been conducted aimed to evaluate the inter-observer variability in clinical target volume (CTV) delineation among different radiation oncologists in radiotherapy treatment of pancreatic cancer.

methodsA multi-institutional contouring dummy-run of two different cases of pancreatic cancer treated by postoperative and preoperative radiotherapy (RT) was performed. Clinical history, diagnostics, and planning CT imaging were available on AIRO website (http://www.radioterapiaitalia.it). Participants were requested to delineate CTVs according to their skills and knowledge. Aiming to quantify interobserver variability of CTVs delineations, the total volume, craniocaudal, laterolateral, and anteroposterior diameters were calculated. Descriptive statistic was calculated. The 95% Confidence Interval (95% CI) for coefficient of variation (CV) was estimated. The Dice Similarity Index (DSI) was used to evaluate the spatial overlap accuracy of the different CTVs compared with the CTVs of a national reference Centre considered as a benchmark. The mean DSI (mDSI) was calculated and reported.

resultsA total of 18 radiation oncologists from different Institutes submitted the targets. Less variability was observed for the Elective CTV rather than the Boost CTV, in both cases. The estimated CV were 28.8% (95% CI: 21.2-45.0%) and 20.0% (95% CI: 14.9-30.6%) for the Elective CTV, in adjuvant (Case 1) and neoadjuvant (Case 2) case, respectively. The mDSI value was 0.68 for the Elective CTVs in both cases (range 0.19-0.79 in postoperative vs range 0.35-0.79 in preoperative case). The mDSI was increased to 0.71 (Case 1) and 0.72 (Case 2) if the observers with a worse agreement have been excluded. On the other hand, a CV of 42.4% (95% CI: 30.1-72.4%) and 63.8% (95% CI: 43.9-119.2%) with a mDSI value of 0.44 and 0.52, were calculated for the Boost CTV in Case 1 and Case 2, respectively.

conclusionsThe CV and mDSI obtained values for Elective CTVs showed an acceptable agreement among participants either in postoperative as well in preoperative setting. Additional strategies to reduce the variability in Boost CTV delineation need to be found and promoted.

Indexed as

AdenocarcinomaAgedFemaleHumansMaleObserver VariationPancreatic NeoplasmsPractice Guidelines as TopicRadiation OncologyRadiotherapy Planning, Computer-Assisted

Identifiers

PMID25199768
PMCPMC4261525

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.