Evidence map›Paper›PMID 35421855›Full record

ReviewPhysics in medicine and biology2022

Towards a safe and efficient clinical implementation of machine learning in radiation oncology by exploring model interpretability, explainability and data-model dependency.

Ana Barragán-Montero, Adrien Bibal, Margerie Huet Dastarac, Camille Draguet, Gilmer Valdés, Dan Nguyen, Siri Willems, Liesbeth Vandewinckele, Mats Holmström, Fredrik Löfman and 3 more

Abstract readReview
In one paragraph

Review in Physics in medicine and biology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Review
  8. Review
  9. Insights into radiomics: a comprehensive review for beginners.Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico · 2025
    Review
  10. Article
  11. Article
  12. Article
  13. Uncertainties in outcome modelling in radiation oncology.Physics and imaging in radiation oncology · 2025
    Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Response letter to WahidPhysics and imaging in radiation oncology · 2024
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Ana Barragán-MonteroMolecular Imaging, Radiation and Oncology (MIRO) Laboratory, Institut de Recherche Expérimentale et Clinique (IREC), UCLouvain, Belgium.ORCID 0000-0002-9485-3076
Adrien BibalPReCISE, NaDI Institute, Faculty of Computer Science, UNamur and CENTAL, ILC, UCLouvain, Belgium.ORCID 0000-0002-8650-8635
Margerie Huet DastaracMolecular Imaging, Radiation and Oncology (MIRO) Laboratory, Institut de Recherche Expérimentale et Clinique (IREC), UCLouvain, Belgium.ORCID 0000-0001-5605-5973
Camille DraguetMolecular Imaging, Radiation and Oncology (MIRO) Laboratory, Institut de Recherche Expérimentale et Clinique (IREC), UCLouvain, Belgium.ORCID 0000-0003-4034-7896
Gilmer ValdésDepartment of Radiation Oncology, Department of Epidemiology and Biostatistics, University of California, San Francisco, United States of America.
Dan NguyenMedical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, UT Southwestern Medical Center, United States of America.ORCID 0000-0002-9590-0655
Siri WillemsESAT/PSI, KU Leuven Belgium & MIRC, UZ Leuven, Belgium.
Liesbeth VandewinckeleDepartment of Oncology, Laboratory of Experimental Radiotherapy, KU Leuven, Belgium.
Mats HolmströmRaySearch Laboratories AB, Sweden.
Fredrik LöfmanRaySearch Laboratories AB, Sweden.
Kevin SourisMolecular Imaging, Radiation and Oncology (MIRO) Laboratory, Institut de Recherche Expérimentale et Clinique (IREC), UCLouvain, Belgium.
Edmond SterpinMolecular Imaging, Radiation and Oncology (MIRO) Laboratory, Institut de Recherche Expérimentale et Clinique (IREC), UCLouvain, Belgium.ORCID 0000-0001-9764-546X
John A LeeMolecular Imaging, Radiation and Oncology (MIRO) Laboratory, Institut de Recherche Expérimentale et Clinique (IREC), UCLouvain, Belgium.ORCID 0000-0001-5218-759X

Funding

Human-like automated radiotherapy treatment planning via imitation learningR01CA254377 · NCI · UT SOUTHWESTERN MEDICAL CENTER · PI JIA, XUN, JIANG, STEVE BIN · 2021 to 2025
$2.9M
Artificial Intelligence-Based Quality Assurance for Online Adaptive RadiotherapyR01CA258987 · NCI · UT SOUTHWESTERN MEDICAL CENTER · PI Steve Bin Jiang, Dan Nguyen · 2022 to 2026
$2.8M
Intelligent treatment planning for cancer radiotherapyR01CA237269 · NCI · UT SOUTHWESTERN MEDICAL CENTER · PI JIA, XUN, JIANG, STEVE BIN · 2019 to 2023
$2.5M
Development of Accurate and Interpretable Machine Learning Algorithms for their application in MedicineK08EB026500 · NIBIB · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI VALDES, GILMER · 2019 to 2022
$739k
NCI NIH HHS R01 CA237269NCI NIH HHS R01 CA254377NCI NIH HHS R01 CA258987NIBIB NIH HHS K08 EB026500
6 · The paper itself

Abstract

The interest in machine learning (ML) has grown tremendously in recent years, partly due to the performance leap that occurred with new techniques of deep learning, convolutional neural networks for images, increased computational power, and wider availability of large datasets. Most fields of medicine follow that popular trend and, notably, radiation oncology is one of those that are at the forefront, with already a long tradition in using digital images and fully computerized workflows. ML models are driven by data, and in contrast with many statistical or physical models, they can be very large and complex, with countless generic parameters. This inevitably raises two questions, namely, the tight dependence between the models and the datasets that feed them, and the interpretability of the models, which scales with its complexity. Any problems in the data used to train the model will be later reflected in their performance. This, together with the low interpretability of ML models, makes their implementation into the clinical workflow particularly difficult. Building tools for risk assessment and quality assurance of ML models must involve then two main points: interpretability and data-model dependency. After a joint introduction of both radiation oncology and ML, this paper reviews the main risks and current solutions when applying the latter to workflows in the former. Risks associated with data and models, as well as their interaction, are detailed. Next, the core concepts of interpretability, explainability, and data-model dependency are formally defined and illustrated with examples. Afterwards, a broad discussion goes through key applications of ML in workflows of radiation oncology as well as vendors' perspectives for the clinical implementation of ML.

Indexed as

Radiation OncologyMachine LearningNeural Networks, Computerclinical implementationinterpretability and explainabilitymachine learningradiation oncologyuncertainty quantification

Identifiers

PMID35421855
PMCPMC9870296

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.