Evidence map›Paper›PMID 40627370›Full record

ArticleThe British journal of radiology2025

Real-world performance evaluation of commercial autocontouring software for head and neck cancer radiotherapy.

Tom Young, Victoria Butterworth, Sarah Misson, Delali Adjogatse, Anthony Kong, Imran Petkar, Miguel Reis Ferreira, Mary Lei, Andrew King, Teresa Guerrero Urbano

Abstract read
In one paragraph

Article in The British journal of radiology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Review
  2. Article
  3. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Tom YoungRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.ORCID 0009-0009-4085-4362
Victoria ButterworthRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.
Sarah MissonRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.
Delali AdjogatseRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.
Anthony KongRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.
Imran PetkarRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.
Miguel Reis FerreiraRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.
Mary LeiRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.
Andrew KingKing's College London, London, SE1 7EU, United Kingdom.
Teresa Guerrero UrbanoRadiotherapy Department, Guy's and St Thomas' NHS Foundation Trust (GSTT), London, SE1 9RT, United Kingdom.ORCID 0000-0003-3090-541X

Funding

Radiation Research Unit at the Cancer Research UK City of London Centre C7893/A28990
6 · The paper itself

Abstract

objectivesTo comprehensively evaluate the ability of ART-Plan (autocontouring software using artificial intelligence [AI]) to contour head and neck cancer (HNC) radiotherapy structures (organs-at-risk and elective nodal volumes) in a real-world setting, as required by NICE guidelines.

methodsRetrospective evaluation (n = 60) compared clinically used contours to AI-contours, using volumetric dice similarity coefficient (VDSC) and blinded radiation oncologist (RO) contour preference assessment. AI-contours were then generated prospectively for HNC radiotherapy patients (n = 61), before review by ROs. ROs recorded qualitative scoring and review/editing time. Geometric and dosimetric comparison of AI-contours and final contours was undertaken. Correlation coefficients between all metrics were calculated.

resultsRetrospective median VDSC varied widely for different structures (0.23-0.88). 31.4% blinded contour assessments preferred clinician-generated contours, 32.9% preferred AI-generated contours, 35.7% saw no significant difference. Prospective evaluation showed AI-contour yielded significant time-saving in reviewing/editing for all structures compared to manual contouring. Qualitative scores demonstrated most structures had median scoring ≥4 (indicating no editing required). Geometric metrics showed high similarity for all structures except larynx. Dosimetric evaluation demonstrated clinically significant dose differences for larynx and elective nodal volumes. Strong correlation was seen between qualitative scoring and all geometric metrics.

conclusionsAI-contours showed excellent qualitative performance and facilitated time-saving. Protocol differences exist between commercial AI-solutions and implementing centres. Ongoing final clinician review of AI-contours remains essential. ADVANCES IN KNOWLEDGE: This is the first study demonstrating ART-Plan's capability for excellent qualitative ratings and significant time-savings for HNC radiotherapy contouring in a real-world workflow setting. 5-point Likert-scale qualitative scoring correlates strongly with geometric metrics.

Indexed as

Artificial IntelligenceHead and Neck NeoplasmsRadiotherapy Planning, Computer-AssistedSoftwareHumansOrgans at RiskRadiotherapy DosageRetrospective Studiesartificial intelligenceautocontouringradiotherapy treatment planning

Identifiers

PMID40627370
PMCPMC12515040

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.