Evidence map›Paper›PMID 38826471›Full record

ArticlemedRxiv : the preprint server for health sciences2024

Effect of Machine Learning on Anaesthesiology Clinician Prediction of Postoperative Complications: The Perioperative ORACLE Randomised Clinical Trial.

Bradley A Fritz, Christopher R King, Mohamed Abdelhack, Yixin Chen, Alex Kronzer, Joanna Abraham, Sandhya Tripathi, Arbi Ben Abdallah, Thomas Kannampallil, Thaddeus P Budelier and 9 more

Registry-linked trialAbstract readPreprint
In one paragraph

Article in medRxiv : the preprint server for health sciences, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05042804 (Perioperative Outcome Risk Assessment With Computer Learning Enhancement), which is not on this map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05042804 nacompletednot on this map

Perioperative Outcome Risk Assessment With Computer Learning Enhancement

TypeinterventionalSponsorWashington University School of MedicineRan2021 to 2022Enrolled5,114ConditionsMorality, Acute Kidney InjuryArmsMachine learning models predicting postoperative death and acute kidney injury
3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

19 authors.

Bradley A FritzDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.ORCID 0000-0002-7239-8877
Christopher R KingDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.ORCID 0000-0002-4574-8616
Mohamed AbdelhackDepartment of Computer Science and Engineering, Washington University McKelvey School of Engineering, Saint Louis, USA.ORCID 0000-0002-6753-3237
Yixin ChenDepartment of Computer Science and Engineering, Washington University McKelvey School of Engineering, Saint Louis, USA.
Alex KronzerDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.
Joanna AbrahamDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.
Sandhya TripathiDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.ORCID 0000-0003-3992-2283
Arbi Ben AbdallahDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.ORCID 0000-0002-1287-0455
Thomas KannampallilDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.ORCID 0000-0003-4119-4836
Thaddeus P BudelierDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.ORCID 0000-0002-8427-5583
Daniel HelstenDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.
Arianna Montes de OcaDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.
Divya MehtaDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.
Pratyush SonthaDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.
Omokhaye HigoDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.ORCID 0009-0007-7997-4551
Paul KerbyDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.
Stephen H GregoryDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.
Troy S WildesDepartment of Anesthesiology, University of Nebraska Medical Center, Omaha, USA.ORCID 0000-0002-9042-571X
Michael S AvidanDepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, USA.ORCID 0000-0001-6248-044X

Funding

TECTONICS (Telemedicine Control Tower for the OR: Navigating Information, Care and Safety) trialR01NR017916 · NINR · WASHINGTON UNIVERSITY · PI AVIDAN, MICHAEL SIMON · 2019 to 2023
$3.1M
NINR NIH HHS R01 NR017916
6 · The paper itself

Abstract

Background: Anaesthesiology clinicians can implement risk mitigation strategies if they know which patients are at greatest risk for postoperative complications. Although machine learning models predicting complications exist, their impact on clinician risk assessment is unknown. Methods: This single-centre randomised clinical trial enrolled patients age ≥18 undergoing surgery with anaesthesiology services. Anaesthesiology clinicians providing remote intraoperative telemedicine support reviewed electronic health records with (assisted group) or without (unassisted group) also reviewing machine learning predictions. Clinicians predicted the likelihood of postoperative 30-day all-cause mortality and postoperative acute kidney injury within 7 days. Area under the receiver operating characteristic curve (AUROC) for the clinician predictions was determined. Results: Among 5,071 patient cases reviewed by 89 clinicians, the observed incidence was 2% for postoperative death and 11% for acute kidney injury. Clinician predictions agreed with the models more strongly in the assisted versus unassisted group (weighted kappa 0.75 versus 0.62 for death [difference 0.13, 95%CI 0.10-0.17] and 0.79 versus 0.54 for kidney injury [difference 0.25, 95%CI 0.21-0.29]). Clinicians predicted death with AUROC of 0.793 in the assisted group and 0.780 in the unassisted group (difference 0.013, 95%CI -0.070 to 0.097). Clinicians predicted kidney injury with AUROC of 0.734 in the assisted group and 0.688 in the unassisted group (difference 0.046, 95%CI -0.003 to 0.091). Conclusions: Although there was evidence that the models influenced clinician predictions, clinician performance was not statistically significantly different with and without machine learning assistance. Further work is needed to clarify the role of machine learning in real-time perioperative risk stratification. Trial Registration: ClinicalTrials.gov NCT05042804.

Identifiers

PMID38826471
PMCPMC11142290

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.