Evidence map›Paper›PMID 40597185›Full record

ArticleBMC medical informatics and decision making2025

Expert-augmented machine learning for predicting extubation readiness in the pediatric intensive care unit.

Jean Digitale, Deborah Franzon, Jin Ge, Charles McCulloch, Mark J Pletcher, Efstathios D Gennatas

Abstract read
In one paragraph

Article in BMC medical informatics and decision making, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Mortality risk prediction from dense PICU data from patients with suspected infection: data-derived physiological trajectories outperform expert assessments when temporal resolution is high.International journal of infectious diseases : IJID : official publication of the International Society for Infectious Diseases · 2026
    Article
  2. Review
  3. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Jean DigitaleDepartment of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, USA. Jean.digitale@ucsf.edu.
Deborah FranzonDepartment of Pediatrics, Benioff Children's Hospital, University of California, San Francisco, San Francisco, CA, USA.
Jin GeDivision of Gastroenterology and Hepatology, Department of Medicine, University of California, San Francisco, CA, USA.
Charles McCullochDepartment of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, USA.
Mark J PletcherDepartment of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, USA.
Efstathios D GennatasDepartment of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, USA.

Funding

UCSF Liver Core CenterP30DK026743 · NIDDK · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Jennifer Y. Chen · 1986 to 2026
$30.7M
A pragmatic RCT to evaluate the effect of CirrhosisRx, a novel clinical decision support system, versus usual care on guideline-adherence and clinical outcomes for patients with cirrhosisK23DK139455 · NIDDK · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Jin Ge · 2024 to 2026
$569k
Predicting earliest safe extubation time in pediatric patientsF31HL156498 · NHLBI · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI DIGITALE, JEAN · 2021 to 2023
$118k
NHLBI NIH HHS F31 HL156498NHLBI NIH HHS F31HL156498NIDDK NIH HHS K23 DK139455NIDDK NIH HHS K23DK139455NIDDK NIH HHS P30 DK026743UCSF Liver Center Grant P30DK026743
6 · The paper itself

Abstract

backgroundDetermining extubation readiness in pediatric intensive care units (PICU) is challenging. We used expert-augmented machine learning (EAML), a method that combines machine learning with human expert knowledge, to predict successful extubation.

methodsWe extracted electronic health record data from patients in two PICUs. Data from patients in one unit was split into 80% training and 20% test, while patients in the other served as an external test set. EAML begins by training RuleFit, which converts gradient-boosted trees into decision rules. Then, expert clinicians were asked to assess the relative probability of successful extubation of the subgroup defined by each rule compared with the entire sample. The rules were ranked in order of increasing chance of successful extubation according to (1) the RuleFit model and (2) clinician assessment, and differences between the two rankings were calculated. The initial RuleFit model was then regularized based on these differences, producing the EAML model.

resultsThe RuleFit model selected 46 rules; we surveyed 25 clinician experts to provide feedback on them. All clinicians worked in a PICU setting and were from multiple disciplines; over half (56%) had > 5 years of PICU experience. As expected, the added regularization slightly lowered performance of EAML compared with RuleFit in the internal test set, although the difference was not statistically significant (RuleFit AUC = 0.817 vs. best-performing EAML model AUC = 0.814, difference = 0.003, 95% CI of difference = -0.009, 0.003). EAML had superior performance in the external test set (RuleFit AUC = 0.791 vs. best-performing EAML model AUC = 0.799, difference = 0.007, 95% CI of difference = 0.002, 0.013).

conclusionsWhen creating a model to predict successful extubation in PICU patients, incorporating expert knowledge directly into the model construction process via EAML produced a model more generalizable to an external test set.

Indexed as

Airway ExtubationIntensive Care Units, PediatricMachine LearningChildChild, PreschoolElectronic Health RecordsFemaleHumansInfantMaleClinical prediction modelExpert-augmented machine learningInterpretabilityMachine learning

Identifiers

PMID40597185
PMCPMC12220236

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.