Evidence map›Paper›PMID 40745381›Full record

ArticleCommunications medicine2025

A comprehensive multifaceted technical evaluation framework for implementation of auto-segmentation models in radiotherapy.

Robert Poel, Elias Rüfenacht, Stefan Scheib, Hossein Hemmatazad, Reinhardt Krcek, Sébastien Tran, Edourd Romano, Susanne Rogers, Sonja Stieb, Mohamed Riyas Poolakundan and 12 more

Abstract read
In one paragraph

Article in Communications medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Multimodal PET-MR segmentation for glioblastoma: complementarity for treatment planning and recurrence definition.Cancer imaging : the official publication of the International Cancer Imaging Society · 2026
    Article
  2. Article
  3. Article
  4. Quantifying manual editing time in autocontouring via audit log analysis.Physics and imaging in radiation oncology · 2026
    Article
  5. Review
  6. Article
  7. Observational
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

22 authors.

Robert PoelDepartment of Radiation Oncology, Inselspital, Bern University Hospital, and University of Bern, Bern, Switzerland. robert.poel@insel.ch.ORCID http://orcid.org/0000-0002-9817-4935
Elias RüfenachtARTORG Center for Biomedical Research, University of Bern, Bern, Switzerland.ORCID http://orcid.org/0000-0001-6983-1695
Stefan ScheibVarian Medical Systems Imaging Laboratory, GmbH, Dättwil, Switzerland.ORCID http://orcid.org/0000-0001-9566-1132
Hossein HemmatazadDepartment of Radiation Oncology, Inselspital, Bern University Hospital, and University of Bern, Bern, Switzerland.
Reinhardt KrcekDepartment of Radiation Oncology, Inselspital, Bern University Hospital, and University of Bern, Bern, Switzerland.
Sébastien TranDepartment of Radiation Oncology, Geneva University Hospital, Geneva, Switzerland.
Edourd RomanoDepartment of Radiation Oncology, Geneva University Hospital, Geneva, Switzerland.
Susanne RogersRadio-Onkologie-Zentrum KSA-KSB, Kantonsspital Aarau, Aargau, Switzerland.
Sonja StiebRadio-Onkologie-Zentrum KSA-KSB, Kantonsspital Aarau, Aargau, Switzerland.
Mohamed Riyas PoolakundanRadiation Oncology, National Center for Cancer Care and Research (NCCCR), Hamad Medical Corporation, Doha, Qatar.
Hissa Hussein Al-AbdullaRadiation Oncology, National Center for Cancer Care and Research (NCCCR), Hamad Medical Corporation, Doha, Qatar.
Robert FoersterDepartment of Radiation Oncology, Cantonal Hospital Winterthur, Winterthur, Switzerland.ORCID http://orcid.org/0000-0002-7664-9207
Christina SchröderDepartment of Radiation Oncology, Cantonal Hospital Winterthur, Winterthur, Switzerland.
Christoph OehlerDepartment of Radiation Oncology, Cantonal Hospital Winterthur, Winterthur, Switzerland.
Julian HongUniversity of California, Department of Radiation Oncology, San Francisco, USA.ORCID http://orcid.org/0000-0001-5172-6889
Sebastiaan BreedveldErasmus MC Cancer Institute, University Medical Center Rotterdam, Department of Radiotherapy, Rotterdam, The Netherlands.ORCID http://orcid.org/0000-0001-8954-4554
Nicolaus AndratschkeDepartment of Radiation Oncology, University Hospital Zurich, University of Zurich, Zurich, Switzerland.ORCID http://orcid.org/0000-0003-3647-5916
Peter ManserDivision of Medical Radiation Physics, Inselspital, Bern University Hospital, and University of Bern, Bern, Switzerland.
Michael K FixDivision of Medical Radiation Physics, Inselspital, Bern University Hospital, and University of Bern, Bern, Switzerland.ORCID http://orcid.org/0000-0002-3911-3403
Daniel M AebersoldDepartment of Radiation Oncology, Inselspital, Bern University Hospital, and University of Bern, Bern, Switzerland.
Mauricio ReyesARTORG Center for Biomedical Research, University of Bern, Bern, Switzerland.
Ekin ErmişDepartment of Radiation Oncology, Inselspital, Bern University Hospital, and University of Bern, Bern, Switzerland.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundManual contouring of organs at risk in radiotherapy is time-consuming, taking 1-4 hours per case. Automatic segmentation using deep learning has emerged as a promising solution, with many commercial options now available. However, these methods require rigorous validation before clinical use, and current evaluation approaches lack consistency and comprehensive assessment across publications.

methodsWe developed the Comprehensive Multifaceted Technical Evaluation framework, which integrates four key assessment components: quantitative geometric measures, qualitative expert evaluation, time efficiency analysis, and dosimetric evaluation. We demonstrated this framework using an in-house automatic segmentation model for brain organs at risk, trained on 100 cases and evaluated by 8 radiation oncology experts from 4 institutions. The evaluation included geometric accuracy measurements, expert ratings of clinical acceptability, time-saving assessments, and dosimetric impact analysis comparing treatment plans.

resultsHere we show that our automatic segmentation model achieved an overall geometric accuracy of 0.78 and outperformed manual inter-rater variability. Expert evaluation revealed that 88% of automatically segmented structures were clinically acceptable with only minor adjustments needed. The evaluation and adjustment process averaged 22 minutes compared to 69 minutes for manual contouring. Dosimetric analysis showed minimal impact on treatment plans, with average dose differences of 0.30 Gray for mean dose and 0.23 Gray for maximum dose.

conclusionsThe framework provides a robust method for validating automatic segmentation models in radiotherapy. However, establishing standardized benchmarks and consensus guidelines within the radiotherapy community remains essential for proper clinical implementation and comparison of different segmentation tools.

Identifiers

PMID40745381
PMCPMC12313850

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.