Evidence map›Paper›PMID 40138535›Full record

Observational studyCritical care explorations2025

Multicenter Development and Prospective Validation of eCARTv5: A Gradient-Boosted Machine-Learning Early Warning Score.

Matthew M Churpek, Kyle A Carey, Ashley Snyder, Christopher J Winslow, Emily Gilbert, Nirav S Shah, Brian W Patterson, Majid Afshar, Alan Weiss, Devendra N Amin and 2 more

Abstract readMulticenter StudyObservational StudyValidation Study
In one paragraph

Observational study in Critical care explorations, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Observational
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors.

Matthew M ChurpekDepartment of Medicine, University of Wisconsin-Madison, Madison, WI.
Kyle A CareyDepartment of Medicine, University of Chicago, Chicago, IL.
Ashley SnyderAgileMD, San Francisco, CA.
Christopher J WinslowDepartment of Medicine, Endeavor Health, Evanston, IL.
Emily GilbertDepartment of Medicine, Loyola University Medical Center, Chicago, IL.
Nirav S ShahDepartment of Medicine, Endeavor Health, Evanston, IL.
Brian W PattersonDepartment of Biostatistics and Medical Informatics, University of Wisconsin-Madison, Madison, WI.
Majid AfsharDepartment of Medicine, University of Wisconsin-Madison, Madison, WI.
Alan WeissBayCare, Clearwater, FL.
Devendra N AminBayCare, Clearwater, FL.
Deborah J RhodesDepartment of Medicine, Yale University, New Haven, CT.
Dana P EdelsonDepartment of Medicine, University of Chicago, Chicago, IL.

Funding

Using causal machine learning for personalized treatment recommendations in critically ill patientsR01HL157262 · NHLBI · UNIVERSITY OF WISCONSIN-MADISON · PI Matthew Michael Churpek · 2021 to 2026
$3.1M
NHLBI NIH HHS R01 HL157262
6 · The paper itself

Abstract

backgroundEarly detection of clinical deterioration using machine-learning early warning scores may improve outcomes. However, most implemented scores were developed using logistic regression, only underwent retrospective validation, and were not tested in important subgroups.

objectiveThe objective of our multicenter retrospective and prospective observational study was to develop and prospectively validate a gradient-boosted machine model (eCARTv5) for identifying clinical deterioration on the wards. DERIVATION COHORT: All adult patients admitted to the inpatient medical-surgical wards at seven hospitals in three health systems for model development (2006-2022). VALIDATION COHORT: All adult patients admitted to the inpatient medical-surgical wards and at 21 hospitals from three health systems for retrospective (2009-2023) and prospective (2023-2024) external validation. PREDICTION MODEL: Predictor variables (demographics, vital signs, documentation, and laboratory values) were used in a gradient-boosted trees algorithm to predict ICU transfer or death in the next 24 hours. The developed model (eCARTv5) was compared with the Modified Early Warning Score (MEWS), the National Early Warning Score (NEWS), and eCARTv2 using the area under the receiver operating characteristic curve (AUROC).

resultsThe development cohort included 901,491 admissions, the retrospective validation cohort included 1,769,461 admissions, and the prospective validation cohort included 205,946 admissions. In retrospective validation, eCARTv5 had the highest AUROC (0.834; 95% CI, 0.834-0.835), followed by eCARTv2 (0.775 [95% CI, 0.775-0.776]), NEWS (0.766 [95% CI, 0.766-0.767]), and MEWS (0.704 [95% CI, 0.703-0.704]). eCARTv5's performance remained high (AUROC ≥0.80) across a range of patient demographics, clinical conditions, and during prospective validation.

conclusionWe developed eCARTv5, which performed better than eCARTv2, NEWS, and MEWS retrospectively, prospectively, and across a range of subgroups. These results served as the foundation for Food and Drug Administration clearance for its use in identifying deterioration in hospitalized ward patients.

Indexed as

Clinical DeteriorationEarly Warning ScoreMachine LearningAdultAgedFemaleHumansIntensive Care UnitsMaleMiddle AgedProspective StudiesRetrospective StudiesROC Curve

Identifiers

PMID40138535
PMCPMC11949291

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.