Evidence map›Paper›PMID 39574153›Full record

ArticleRadiation oncology (London, England)2024

Artificial intelligence contouring in radiotherapy for organs-at-risk and lymph node areas.

Céline Meyer, Sandrine Huger, Marie Bruand, Thomas Leroy, Jérémy Palisson, Paul Rétif, Thomas Sarrade, Anais Barateau, Sophie Renard, Maria Jolnerovski and 16 more

Erratum issuedAbstract read
In one paragraph

Article in Radiation oncology (London, England), 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

26 authors.

Céline MeyerAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Sandrine HugerMedical Physics Department, Institut de Cancérologie de Lorraine - Alexis-Vautrin, Vandœuvre-Lès-Nancy, France.
Marie BruandAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Thomas LeroyRadiation department, Clinique Les Dentelières, Valenciennes, France.
Jérémy PalissonMedical Physics Department, Centre de la Baie, Avranches, France.
Paul RétifMedical Physics Department, CHR Metz-Thionville, Metz, France.
Thomas SarradeRadiation Department, AP-HP, Hôpital Tenon, Paris, France.
Anais BarateauMedical Physics Department, Centre Eugène Marquis, Rennes, France.
Sophie RenardAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Maria JolnerovskiAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Nicolas DemogeotAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Johann MarcelAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Nicolas MartzAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Anaïs StefaniAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Selima SellamiAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Juliette JacquesAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Emma AgnouxAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
William GehinAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Ida TrampettiAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Agathe MarguliesAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Constance GolfierAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Yassir KhattabiAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Olivier CravéreauAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Alizée RenanAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Jean-François PyAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France.
Jean-Christophe FaivreAcademic Department of Radiation Therapy & Brachytherapy, Institut de Cancérologie de Lorraine - Alexis-Vautrin CLCC - Unicancer, 6 avenue de Bourgogne - CS 30 519, 54 511, Vandoeuvre-Lès-Nancy Cedex, France. jc.faivre@nancy.unicancer.fr.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionThe delineation of organs-at-risk and lymph node areas is a crucial step in radiotherapy, but it is time-consuming and associated with substantial user-dependent variability in contouring. Artificial intelligence (AI) appears to be the solution to facilitate and standardize this work. The objective of this study is to compare eight available AI software programs in terms of technical aspects and accuracy for contouring organs-at-risk and lymph node areas with current international contouring recommendations. MATERIAL AND

methodsFrom January-July 2023, we performed a blinded study of the contour scoring of the organs-at-risk and lymph node areas by eight self-contouring AI programs by 20 radiation oncologists. It was a single-center study conducted in radiation department at the Lorraine Cancer Institute. A qualitative analysis of technical characteristics of the different AI programs was also performed. Three adults (two women and one man) and three children (one girl and two boys) provided six whole-body anonymized CT scans, along with two other adult brain MRI scans. Using a scoring scale from 1 to 3 (best score), radiation oncologists blindly assessed the quality of contouring of organs-at-risk and lymph node areas of all scans and MRI data by the eight AI programs. We have chosen to define the threshold of an average score equal to or greater than 2 to characterize a high-performing AI software, meaning an AI with minimal to moderate corrections but usable in clinical routine.

resultsFor adults CT scans: There were two AI programs for which the overall average quality score (that is, all areas tested for OARs and lymph nodes) was higher than 2.0: Limbus (overall average score = 2.03 (0.16)) and MVision (overall average score = 2.13 (0.19)). If we only consider OARs for adults, only Limbus, Therapanacea, MVision and Radformation have an average score above 2. For children CT scan, MVision was the only program to have a average score higher than 2 with overall average score = 2.07 (0.19). If we only consider OARs for children, only Limbus and MVision have an average score above 2. For brain MRIs: TheraPanacea was the only program with an average score over 2, for both brain delineation (2.75 (0.35)) and OARs (2.09 (0.19)). The comparative analysis of the technical aspects highlights the similarities and differences between the software. There is no difference in between senior radiation oncologist and residents for OARs contouring.

conclusionFor adult CT-scan, two AI programs on the market, MVision and Limbus, delineate most OARs and lymph nodes areas that are useful in clinical routine. For children CT-scan, only one IA, MVision, program is efficient. For adult brain MRI, Therapancea,only one AI program is efficient.

trial registrationCNIL-MR0004 Number HDH434.

Indexed as

Artificial IntelligenceLymph NodesOrgans at RiskRadiotherapy Planning, Computer-AssistedAdultChildFemaleHumansMagnetic Resonance ImagingMaleSoftwareTomography, X-Ray Computed

Identifiers

PMID39574153
PMCPMC11580215

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.