Evidence map›Paper›PMID 38586278›Full record

ArticleNEJM AI2024

Health Care Cost Reductions with Machine Learning-Directed Evaluations during Radiation Therapy - An Economic Analysis of a Randomized Controlled Study.

Divya Natesan, Eric L Eisenstein, Samantha M Thomas, Neville C W Eclov, Nicole H Dalal, Sarah J Stephens, Mary Malicki, Stacey Shields, Alyssa Cobb, Yvonne M Mowery and 4 more

Registry-linked trialAbstract read
In one paragraph

Article in NEJM AI, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04277650 (System for High Intensity EvaLuation During Radiation Therapy), which is not on this map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04277650 nacompletednot on this map

System for High Intensity EvaLuation During Radiation Therapy (SHIELD-RT): A Prospective Randomized Study of Machine Learning-directed Clinical Evaluations During Outpatient Cancer Radiation and Chemoradiation

TypeinterventionalSponsorDuke UniversityRan2018 to 2019Enrolled311ConditionsRadiation Therapy Complication, Chemotherapeutic ToxicityArmsMachine learning algorithm
3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Divya NatesanDepartment of Radiation Oncology, University of North Carolina, Chapel Hill, NC.ORCID 0000-0002-3197-3492
Eric L EisensteinDuke Clinical Research Institute, Duke University, Durham, NC.ORCID 0000-0003-0216-428X
Samantha M ThomasDepartment of Biostatistics and Bioinformatics, Duke University, Durham, NC.ORCID 0000-0002-1561-9303
Neville C W EclovDepartment of Radiation Oncology, Duke University, Durham, NC.ORCID 0000-0003-1454-006X
Nicole H DalalDepartment of Radiation Oncology, Duke University, Durham, NC.ORCID 0000-0002-0627-3603
Sarah J StephensDepartment of Radiation Oncology, Duke University, Durham, NC.ORCID 0000-0002-1226-2329
Mary MalickiDepartment of Radiation Oncology, Duke University, Durham, NC.ORCID 0009-0003-6963-3746
Stacey ShieldsDepartment of Radiation Oncology, Duke University, Durham, NC.ORCID 0009-0009-1731-9038
Alyssa CobbDepartment of Radiation Oncology, Duke University, Durham, NC.ORCID 0009-0004-1120-3863
Yvonne M MoweryDepartment of Radiation Oncology, Duke University, Durham, NC.ORCID 0000-0002-9839-2414
Donna NiedzwieckiDepartment of Biostatistics and Bioinformatics, Duke University, Durham, NC.ORCID 0000-0002-3566-0450
Jessica D TenenbaumDepartment of Biostatistics and Bioinformatics, Duke University, Durham, NC.ORCID 0000-0003-3532-565X
Manisha PaltaDepartment of Radiation Oncology, Duke University, Durham, NC.ORCID 0000-0002-9085-9075
Julian C HongDepartment of Radiation Oncology, University of California, San Francisco, San Francisco.ORCID 0000-0001-5172-6889

Funding

Multi-institutional validation of a multi-modal machine learning algorithm to predict and reduce acute care during cancer therapyR01CA277782 · NCI · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Julian Clint Hong · 2023 to 2026
$1.6M
NCI NIH HHS R01 CA277782
6 · The paper itself

Abstract

backgroundMachine learning (ML) may cost-effectively direct health care by identifying patients most likely to benefit from preventative interventions to avoid negative and expensive outcomes. System for High-Intensity Evaluation During Radiation Therapy (SHIELD-RT; NCT04277650) was a single-institution, randomized controlled study in which electronic health record-based ML accurately identified patients at high risk for acute care (emergency visit or hospitalization) during radiotherapy (RT) and targeted them for supplemental clinical evaluations. This ML-directed intervention resulted in decreased acute care utilization. Given the limited prospective data showing the ability of ML to direct interventions

methodsA post hoc economic analysis was conducted of SHIELD-RT that included RT courses from January 7, 2019, to June 30, 2019. ML-identified high-risk courses (≥10% risk of acute care during RT) were randomized to receive standard of care weekly clinical evaluations with ad hoc supplemental evaluations per clinician discretion versus mandatory twice-weekly evaluations. The primary outcome was difference in mean total medical costs during and 15 days after RT. Acute care costs were obtained via institutional cost accounting. Physician and intervention costs were estimated via Medicare and Medicaid data. Negative binomial regression was used to estimate cost outcomes after adjustment for patient and disease factors.

resultsA total of 311 high-risk RT courses among 305 patients were randomized to the standard (n=157) or the intervention (n=154) group. Unadjusted mean intervention group supplemental visit costs were $155 per course (95% confidence interval, $142 to $168). The intervention group had fewer acute care visits per course (standard, 0.47; intervention, 0.31; P=0.04). Total mean adjusted costs were $3110 per course for the standard group and $1494 for the intervention group (difference in means, $1616 [95% confidence interval, $1450 to $1783]; P=0.03).

conclusionsIn this economic analysis of a randomized controlled, health care ML study, mandatory supplemental evaluations for ML-identified high-risk patients were associated with both reduced total medical costs and improved clinical outcomes. Further study is needed to determine whether economic results are generalizable. (Funded in part by The Duke Endowment, The Conquer Cancer Foundation, the Duke Department of Radiation Oncology, and the National Cancer Institute of the National Institutes of Health [R01CA277782]; ClinicalTrials.gov number, NCT04277650.).

Identifiers

PMID38586278
PMCPMC10997376

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.