Evidence map›Paper›PMID 25758641›Full record

SynthesisJournal of hospital medicine2015

Diagnostic accuracy and effectiveness of automated electronic sepsis alert systems: A systematic review.

Anil N Makam, Oanh K Nguyen, Andrew D Auerbach

Abstract readSystematic Review
In one paragraph

Synthesis in Journal of hospital medicine, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 56 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
56citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

56 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Alert fatigue measurement in clinical decision support: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Trial
  10. Trial
  11. Observational
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Anil N MakamDivision of General Internal Medicine, University Texas Southwestern Medical Center, Dallas, Texas.
Oanh K NguyenDivision of General Internal Medicine, University Texas Southwestern Medical Center, Dallas, Texas.
Andrew D AuerbachDivsion of Hospital Medicine, University of California San Francisco, San Francisco, California.

Funding

UT Southwestern Center for Translational Medicine (UL1/KL2/TL1)UL1TR001105 · NCATS · UT SOUTHWESTERN MEDICAL CENTER · PI TOTO, ROBERT DANIEL · 2013 to 2017
$24.5M
UT Southwestern Center for Translational Medicine (UL1/KL2/TL1KL2TR001103 · NCATS · UT SOUTHWESTERN MEDICAL CENTER · PI TOTO, ROBERT DANIEL · 2013 to 2017
$4.0M
Improving management of cardiovascular medications during hospitalizationK24HL098372 · NHLBI · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI AUERBACH, ANDREW D · 2010 to 2014
$887k
AHRQ HHS R24HS022428-01NCATS NIH HHS KL2 TR001103NCATS NIH HHS KL2TR001103NCATS NIH HHS UL1 TR001105NHLBI NIH HHS K24 HL098372NHLBI NIH HHS K24HL098372PHS HHS T32HP19025-07-00
6 · The paper itself

Abstract

backgroundAlthough timely treatment of sepsis improves outcomes, delays in administering evidence-based therapies are common. PURPOSE: To determine whether automated real-time electronic sepsis alerts can: (1) accurately identify sepsis and (2) improve process measures and outcomes. DATA SOURCES: We systematically searched MEDLINE, Embase, The Cochrane Library, and Cumulative Index to Nursing and Allied Health Literature from database inception through June 27, 2014. STUDY SELECTION: Included studies that empirically evaluated 1 or both of the prespecified objectives. DATA EXTRACTION: Two independent reviewers extracted data and assessed the risk of bias. Diagnostic accuracy of sepsis identification was measured by sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and likelihood ratio (LR). Effectiveness was assessed by changes in sepsis care process measures and outcomes. DATA SYNTHESIS: Of 1293 citations, 8 studies met inclusion criteria, 5 for the identification of sepsis (n = 35,423) and 5 for the effectiveness of sepsis alerts (n = 6894). Though definition of sepsis alert thresholds varied, most included systemic inflammatory response syndrome criteria ± evidence of shock. Diagnostic accuracy varied greatly, with PPV ranging from 20.5% to 53.8%, NPV 76.5% to 99.7%, LR+ 1.2 to 145.8, and LR- 0.06 to 0.86. There was modest evidence for improvement in process measures (ie, antibiotic escalation), but only among patients in non-critical care settings; there were no corresponding improvements in mortality or length of stay. Minimal data were reported on potential harms due to false positive alerts.

conclusionsAutomated sepsis alerts derived from electronic health data may improve care processes but tend to have poor PPV and do not improve mortality or length of stay.

Indexed as

Decision Support Systems, ClinicalClinical AlarmsDatabases, BibliographicDiagnosis, DifferentialEarly DiagnosisHumansMedical Order Entry SystemsOutcome Assessment, Health CarePredictive Value of TestsReproducibility of ResultsSepsis

Identifiers

PMID25758641
PMCPMC4477829

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.