Evidence map›Paper›PMID 36180836›Full record

ArticleBMC bioinformatics2022

Implementation of machine learning in the clinic: challenges and lessons in prospective deployment from the System for High Intensity EvaLuation During Radiation Therapy (SHIELD-RT) randomized controlled study.

Julian C Hong, Neville C W Eclov, Sarah J Stephens, Yvonne M Mowery, Manisha Palta

Registry-linked trialOpen access · goldAbstract read
In one paragraph

Article in BMC bioinformatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04277650 (System for High Intensity EvaLuation During Radiation Therapy), which is not on this map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
0.6field-weighted citation impact, top 25% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04277650 nacompletednot on this map

System for High Intensity EvaLuation During Radiation Therapy (SHIELD-RT): A Prospective Randomized Study of Machine Learning-directed Clinical Evaluations During Outpatient Cancer Radiation and Chemoradiation

TypeinterventionalSponsorDuke UniversityRan2018 to 2019Enrolled311ConditionsRadiation Therapy Complication, Chemotherapeutic ToxicityArmsMachine learning algorithm
3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 10 citations in OpenAlex.

  1. Trial
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Julian C HongDepartment of Radiation Oncology, University of California, San Francisco, 1825 Fourth Street, Suite L1101, San Francisco, CA, 94158, USA. julian.hong@ucsf.edu.ORCID http://orcid.org/0000-0001-5172-6889
Neville C W EclovDepartment of Radiation Oncology, Duke University, Durham, NC, USA.
Sarah J StephensDepartment of Radiation Oncology, Duke University, Durham, NC, USA.
Yvonne M MoweryDepartment of Radiation Oncology, Duke University, Durham, NC, USA.
Manisha PaltaDepartment of Radiation Oncology, Duke University, Durham, NC, USA.
Duke University · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundArtificial intelligence (AI) and machine learning (ML) have resulted in significant enthusiasm for their promise in healthcare. Despite this, prospective randomized controlled trials and successful clinical implementation remain limited. One clinical application of ML is mitigation of the increased risk for acute care during outpatient cancer therapy. We previously reported the results of the System for High Intensity EvaLuation During Radiation Therapy (SHIELD-RT) study (NCT04277650), which was a prospective, randomized quality improvement study demonstrating that ML based on electronic health record (EHR) data can direct supplemental clinical evaluations and reduce the rate of acute care during cancer radiotherapy with and without chemotherapy. The objective of this study is to report the workflow and operational challenges encountered during ML implementation on the SHIELD-RT study.

resultsData extraction and manual review steps in the workflow represented significant time commitments for implementation of clinical ML on a prospective, randomized study. Barriers include limited data availability through the standard clinical workflow and commercial products, the need to aggregate data from multiple sources, and logistical challenges from altering the standard clinical workflow to deliver adaptive care.

conclusionsThe SHIELD-RT study was an early randomized controlled study which enabled assessment of barriers to clinical ML implementation, specifically those which leverage the EHR. These challenges build on a growing body of literature and may provide lessons for future healthcare ML adoption.

trial registrationNCT04277650. Registered 20 February 2020. Retrospectively registered quality improvement study.

Indexed as

Artificial IntelligenceNeoplasmsElectronic Health RecordsHumansMachine LearningProspective StudiesRandomized Controlled Trials as TopicArtificial intelligenceChemoradiationImplementationMachine learningQuality improvementRadiation therapy

Identifiers

PMID36180836
PMCPMC9526253
OpenAlexW4298042774

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.