Evidence map›Paper›PMID 39222214›Full record

ArticlePhysical and engineering sciences in medicine2024

Investigation on performance of multiple AI-based auto-contouring systems in organs at risks (OARs) delineation.

Young Woo Kim, Simon Biggs, Elizabeth Claridge Mackonis

Abstract read
In one paragraph

Article in Physical and engineering sciences in medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Developing a web-based dashboard for adaptive radiotherapy workflows.Journal of applied clinical medical physics · 2026
    Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Review
  13. Review
  14. Article
  15. Article
  16. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Young Woo KimDepartment of Radiation Oncology, Chris O'Brien Lifehouse, Sydney, NSW, Australia.ORCID http://orcid.org/0000-0002-5818-950X
Simon Biggs *Radiotherapy AI, Sydney, NSW, Australia.
Elizabeth Claridge Mackonis *Department of Radiation Oncology, Chris O'Brien Lifehouse, Sydney, NSW, Australia. elizabeth.mackonis@lh.org.au.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Manual contouring of organs at risk (OAR) is time-consuming and subject to inter-observer variability. AI-based auto-contouring is proposed as a solution to these problems if it can produce clinically acceptable results. This study investigated the performance of multiple AI-based auto-contouring systems in different OAR segmentations. The auto-contouring was performed using seven different AI-based segmentation systems (Radiotherapy AI, Limbus AI version 1.5 and 1.6, Therapanacea, MIM, Siemens AI-Rad Companion and RadFormation) on a total of 42 clinical cases with varying anatomical sites. Volumetric and surface dice similarity coefficients and maximum Hausdorff distance (HD) between the expert's contours and automated contours were calculated to evaluate their performance. Radiotherapy AI has shown better performance than other software in most tested structures considered in the head and neck, and brain cases. No specific software had shown overall superior performance over other software in lung, breast, pelvis and abdomen cases. Each tested AI system was able to produce comparable contours to the experts' contours of organs at risk which can potentially be used for clinical use. A reduced performance of AI systems in the case of small and complex anatomical structures was found and reported, showing that it is still essential to review each contour produced by AI systems for clinical uses. This study has also demonstrated a method of comparing contouring software options which could be replicated in clinics or used for ongoing quality assurance of purchased systems.

Indexed as

Organs at RiskAlgorithmsArtificial IntelligenceHumansImage Processing, Computer-AssistedSoftwareTomography, X-Ray ComputedArtificial Intelligence (AI)Auto contouringAuto segmentationRadiation therapy planning

Identifiers

PMID39222214
PMCPMC11408550

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.