Evidence map›Paper›PMID 30811322›Full record

SynthesisJournal of hospital medicine2019

Statistical Modeling and Aggregate-Weighted Scoring Systems in Prediction of Mortality and ICU Transfer: A Systematic Review.

Daniel T Linnen, Gabriel J Escobar, Xiao Hu, Elizabeth Scruth, Vincent Liu, Caroline Stephens

Abstract readSystematic Review
In one paragraph

Synthesis in Journal of hospital medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Observational
  5. Article
  6. Article
  7. Clinical evaluation of a machine learning-based early warning system for patient deterioration.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2024
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2021
    Article
  13. Article
  14. Implementing machine learning in medicine.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2021
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Daniel T LinnenKaiser Permanente Northern California, Kaiser Foundation Hospitals, Inc., Patient Care Services, Nurse Scholars Academy, Oakland, California.
Gabriel J EscobarKaiser Permanente Northern California, The Permanente Medical Group, Inc., Division of Research, Oakland, California.
Xiao HuUniversity of California, San Francisco, School of Nursing, Department of Physiological Nursing, San Francisco, California.
Elizabeth ScruthKaiser Permanente Northern California, Kaiser Foundation Hospitals, Inc., Department of Quality, Oakland, California.
Vincent LiuKaiser Permanente Northern California, The Permanente Medical Group, Inc., Division of Research, Oakland, California.
Caroline StephensUniversity of California, San Francisco, School of Nursing, Department of Community Health Systems, San Francisco, California.

Funding

Identifying pre-sepsis opportunities for early, targeted intervention - Equipment SupplementR35GM128672 · NIGMS · KAISER FOUNDATION RESEARCH INSTITUTE · PI Vincent Liu · 2018 to 2026
$4.3M
Develop&validate SuperAlarm to detect patient deterioration with few false alarmsR01HL128679 · NHLBI · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI HU, XIAO · 2015 to 2018
$2.4M
Improving Palliative Care Access Through Technology (ImPAcTT): A Multi-Component Pilot StudyK76AG054862 · NIA · UNIVERSITY OF UTAH · PI STEPHENS, CAROLINE · 2017 to 2021
$1.2M
Data-driven Precision medicine in sepsisK23GM112018 · NIGMS · KAISER FOUNDATION RESEARCH INSTITUTE · PI LIU, VINCENT · 2014 to 2017
$768k
NHLBI NIH HHS R01 HL128679NIA NIH HHS K76 AG054862NIGMS NIH HHS K23 GM112018NIGMS NIH HHS R35 GM128672
6 · The paper itself

Abstract

backgroundThe clinical deterioration of patientsin general hospital wards is an important safety issue. Aggregate-weighted early warning systems (EWSs) may not detect risk until patients present with acute decline. PURPOSE: We aimed to compare the prognostic test accuracy and clinical workloads generated by EWSs using statistical modeling (multivariable regression or machine learning) versus aggregate-weighted tools. DATA SOURCES: We searched PubMed and CINAHL using terms that described clinical deterioration and use of an advanced EWS. STUDY SELECTION: The outcome was clinical deterioration (intensive care unit transfer or death) of adult patients on general hospital wards. We included studies published from January 1, 2012 to September 15, 2018. DATA EXTRACTION: Following 2015 PRIMSA systematic review protocol guidelines; 2015 TRIPOD criteria for predictive model evaluation; and the Cochrane Collaboration guidelines, we reported model performance, adjusted positive predictive value (PPV), and conducted simulations of workup-to-detection ratios. DATA SYNTHESIS: Of 285 articles, six studies reported the model performance of advanced EWSs, and five were of high quality. All EWSs using statistical modeling identified at-risk patients with greater precision than aggregate-weighted EWSs (mean AUC 0.80 vs 0.73). EWSs using statistical modeling generated 4.9 alerts to find one true positive case versus 7.1 alerts in aggregate-weighted EWSs; a nearly 50% relative workload increase for aggregate-weighted EWSs.

conclusionsCompared with aggregate-weighted tools, EWSs using statistical modeling consistently demonstrated superior prognostic performance and generated less workload to identify and treat one true positive case. A standardized approach to reporting EWS model performance is needed, including outcome definitions, pretest probability, observed and adjusted PPV, and workup-to-detection ratio.

Indexed as

Clinical DeteriorationEarly Warning ScoreMortalityHumansIntensive Care UnitsModels, StatisticalPatients' RoomsPatient Transfer

Identifiers

PMID30811322
PMCPMC6628701

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.