Evidence map›Paper›PMID 33109167›Full record

ArticleBMC medical informatics and decision making2020

Validation of a machine learning algorithm for early severe sepsis prediction: a retrospective study predicting severe sepsis up to 48 h in advance using a diverse dataset from 461 US hospitals.

Hoyt Burdick, Eduardo Pino, Denise Gabel-Comeau, Carol Gu, Jonathan Roberts, Sidney Le, Joseph Slote, Nicholas Saber, Emily Pellegrini, Abigail Green-Saxena and 2 more

Open access · goldAbstract read
In one paragraph

Article in BMC medical informatics and decision making, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 4 pooled it
3.5field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 4 syntheses or guidelines pooled it, 38 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Article
  6. Article
  7. Article
  8. Be-SNAP: the Belgian Sepsis National Action Plan.Frontiers in public health · 2025
    Article
  9. Review
  10. Digital health delivery in respiratory medicine: adjunct, replacement or cause for division?European respiratory review : an official journal of the European Respiratory Society · 2024
    Review
  11. Article
  12. Article
  13. Article
  14. Review
  15. Review
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 2 institutions in 1 country.

Hoyt BurdickCabell Huntington Hospital, Huntington, WV, USA.
Eduardo PinoCabell Huntington Hospital, Huntington, WV, USA.
Denise Gabel-ComeauCabell Huntington Hospital, Huntington, WV, USA.
Carol GuDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA.
Jonathan RobertsDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA.
Sidney LeDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA.
Joseph SloteDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA.
Nicholas SaberDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA.
Emily PellegriniDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA.
Abigail Green-SaxenaDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA. abigail@dascena.com.ORCID 0000-0002-8502-6589
Jana HoffmanDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA.
Ritankar DasDascena, Inc., P.O. Box 156572, San Francisco, CA, 94115, USA.
Dascena (United States) · USCabell Huntington Hospital · US

Funding

Using clinical treatment data in a machine learning approach for sepsis detectionR43TR002309 · NCATS · DASCENA, INC. · PI DAS, RITANKAR · 2018 to 2018
$325k
A computational approach to early sepsis detectionR43TR002221 · NCATS · DASCENA, INC. · PI DAS, RITANKAR · 2018 to 2018
$311k
NCATS NIH HHS 1R43TR002221NCATS NIH HHS 1R43TR002309NCATS NIH HHS R43 TR002221NCATS NIH HHS R43 TR002309
6 · The paper itself

Abstract

backgroundSevere sepsis and septic shock are among the leading causes of death in the United States and sepsis remains one of the most expensive conditions to diagnose and treat. Accurate early diagnosis and treatment can reduce the risk of adverse patient outcomes, but the efficacy of traditional rule-based screening methods is limited. The purpose of this study was to develop and validate a machine learning algorithm (MLA) for severe sepsis prediction up to 48 h before onset using a diverse patient dataset.

methodsRetrospective analysis was performed on datasets composed of de-identified electronic health records collected between 2001 and 2017, including 510,497 inpatient and emergency encounters from 461 health centers collected between 2001 and 2015, and 20,647 inpatient and emergency encounters collected in 2017 from a community hospital. MLA performance was compared to commonly used disease severity scoring systems and was evaluated at 0, 4, 6, 12, 24, and 48 h prior to severe sepsis onset.

results270,438 patients were included in analysis. At time of onset, the MLA demonstrated an AUROC of 0.931 (95% CI 0.914, 0.948) and a diagnostic odds ratio (DOR) of 53.105 on a testing dataset, exceeding MEWS (0.725, P < .001; DOR 4.358), SOFA (0.716; P < .001; DOR 3.720), and SIRS (0.655; P < .001; DOR 3.290). For prediction 48 h prior to onset, the MLA achieved an AUROC of 0.827 (95% CI 0.806, 0.848) on a testing dataset. On an external validation dataset, the MLA achieved an AUROC of 0.948 (95% CI 0.942, 0.954) at the time of onset, and 0.752 at 48 h prior to onset.

conclusionsThe MLA accurately predicts severe sepsis onset up to 48 h in advance using only readily available vital signs extracted from the existing patient electronic health records. Relevant implications for clinical practice include improved patient outcomes from early severe sepsis detection and treatment.

Indexed as

Decision Support Systems, ClinicalAlgorithmsDatasets as TopicFemaleForecastingHospital MortalityHumansIntensive Care UnitsMachine LearningMalePredictive Value of TestsReproducibility of ResultsRetrospective StudiesSepsisSeverity of Illness IndexTime FactorsDiagnosticMachine learning algorithmSepsis predictionSevere sepsis

Identifiers

PMID33109167
PMCPMC7590695
OpenAlexW3097374997

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.