Evidence map›Paper›PMID 38648576›Full record

ArticleJCO clinical cancer informatics2024

Explainable Machine Learning Model to Preoperatively Predict Postoperative Complications in Inpatients With Cancer Undergoing Major Operations.

Matthew C Hernandez, Chen Chen, Andrew Nguyen, Kevin Choong, Cameron Carlin, Rebecca A Nelson, Lorenzo A Rossi, Naini Seth, Kathy McNeese, Bertram Yuh and 2 more

Open access · hybridAbstract read
In one paragraph

Article in JCO clinical cancer informatics, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
2.0field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 5 citations in OpenAlex.

  1. Review
  2. Article
  3. Review
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 3 institutions in 1 country.

Matthew C HernandezDepartment of Surgery, University of New Mexico, Albuquerque, NM.ORCID 0000-0001-8579-2702
Chen ChenDepartment of Applied AI and Data Science, City of Hope National Medical Center, Duarte, CA.ORCID 0000-0002-6563-5475
Andrew NguyenDepartment of Surgery, City of Hope National Medical Center, Duarte, CA.
Kevin ChoongDepartment of Surgery, Division of Oncology, Primas Health, University of South Carolina Medical School, Greeneville, SC.ORCID 0000-0002-6521-7695
Cameron CarlinDepartment of Applied AI and Data Science, City of Hope National Medical Center, Duarte, CA.
Rebecca A NelsonDepartment of Computational and Quantitative Medicine, Division of Biostatistics, City of Hope National Medical Center, Duarte, CA.ORCID 0000-0002-1678-6285
Lorenzo A RossiDepartment of Applied AI and Data Science, City of Hope National Medical Center, Duarte, CA.ORCID 0000-0002-0689-9024
Naini SethDepartment of Clinical Informatics, City of Hope National Medical Center, Duarte, CA.
Kathy McNeeseDepartment of Surgery, University of New Mexico, Albuquerque, NM.
Bertram YuhDepartment of Surgery, University of New Mexico, Albuquerque, NM.
Zahra EftekhariDepartment of Applied AI and Data Science, City of Hope National Medical Center, Duarte, CA.
Lily L LaiDepartment of Surgery, University of New Mexico, Albuquerque, NM.ORCID 0000-0001-6639-4485
City Of Hope National Medical Center · USUniversity of New Mexico · USMedical University of South Carolina · US

Funding

Transgenic Mouse FacilityP30CA033572 · NCI · CITY OF HOPE/BECKMAN RESEARCH INSTITUTE · PI John Charles Williams · 1985 to 2026
$86.3M
NCI NIH HHS P30 CA033572
6 · The paper itself

Abstract

purposePreoperative prediction of postoperative complications (PCs) in inpatients with cancer is challenging. We developed an explainable machine learning (ML) model to predict PCs in a heterogenous population of inpatients with cancer undergoing same-hospitalization major operations.

methodsConsecutive inpatients who underwent same-hospitalization operations from December 2017 to June 2021 at a single institution were retrospectively reviewed. The ML model was developed and tested using electronic health record (EHR) data to predict 30-day PCs for patients with Clavien-Dindo grade 3 or higher (CD 3+) per the CD classification system. Model performance was assessed using area under the receiver operating characteristic curve (AUROC), area under the precision recall curve (AUPRC), and calibration plots. Model explanation was performed using the Shapley additive explanations (SHAP) method at cohort and individual operation levels.

resultsA total of 988 operations in 827 inpatients were included. The ML model was trained using 788 operations and tested using a holdout set of 200 operations. The CD 3+ complication rates were 28.6% and 27.5% in the training and holdout test sets, respectively. Training and holdout test sets' model performance in predicting CD 3+ complications yielded an AUROC of 0.77 and 0.73 and an AUPRC of 0.56 and 0.52, respectively. Calibration plots demonstrated good reliability. The SHAP method identified features and the contributions of the features to the risk of PCs.

conclusionWe trained and tested an explainable ML model to predict the risk of developing PCs in patients with cancer. Using patient-specific EHR data, the ML model accurately discriminated the risk of developing CD 3+ complications and displayed top features at the individual operation and cohort level.

Indexed as

InpatientsMachine LearningNeoplasmsPostoperative ComplicationsAgedElectronic Health RecordsFemaleHumansMaleMiddle AgedRetrospective StudiesRisk AssessmentROC Curve

Identifiers

PMID38648576
PMCPMC11161247
OpenAlexW4395014843

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.