Evidence map›Paper›PMID 34504260›Full record

ArticleNPJ digital medicine2021

Artificial intelligence sepsis prediction algorithm learns to say "I don't know".

Supreeth P Shashikumar, Gabriel Wardi, Atul Malhotra, Shamim Nemati

Open access · goldAbstract read
In one paragraph

Article in NPJ digital medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 71 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
71citing papers in PubMed, 2 pooled it
9.9field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

71 citing papers in PubMed, 2 syntheses or guidelines pooled it, 103 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Review
  7. Review
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Review
  16. Review
  17. Article
  18. Article
  19. Review
  20. Observational

11 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 3 institutions in 1 country.

Supreeth P ShashikumarDivision of Biomedical Informatics, University of California San Diego, San Diego, USA. spshashikumar@health.ucsd.edu.ORCID http://orcid.org/0000-0002-0348-4261
Gabriel WardiDepartment of Emergency Medicine, University of California San Diego, San Diego, USA.
Atul MalhotraDivision of Pulmonary, Critical Care and Sleep Medicine, University of California San Diego, San Diego, USA.
Shamim NematiDivision of Biomedical Informatics, University of California San Diego, San Diego, USA. snemati@health.ucsd.edu.ORCID http://orcid.org/0000-0002-0520-4948
University of California System · USUC San Diego Health System · USUniversity of San Diego · US

Funding

GeneRAlizable Sepsis Phenotyping (GRASP) using Electronic Health Records and Continuous Monitoring SensorsR35GM143121 · NIGMS · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI NEMATI, SHAMIM · 2021 to 2025
$2.2M
Deep Learning and Streaming Analytics for Prediction of Adverse Events in the ICUK01ES025445 · NIEHS · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI NEMATI, SHAMIM · 2015 to 2019
$951k
Enhanced Metadata Design, Architecture, and Learning (MeDAL) for Development of Generalizable Deep Learning-based Predictive Analytics from Electronic Health RecordsR56LM013517 · NLM · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI NEMATI, SHAMIM · 2020 to 2020
$394k
Foundation for the National Institutes of Health (Foundation for the National Institutes of Health, Inc.) R56LM013517Gordon and Betty Moore Foundation (Gordon E. and Betty I. Moore Foundation) GBMF9052NIEHS NIH HHS K01 ES025445NIGMS NIH HHS R35 GM143121NLM NIH HHS R56 LM013517U.S. Department of Health & Human Services | Biomedical Advanced Research and Development Authority (BARDA) HHSO100201900015C
6 · The paper itself

Abstract

Sepsis is a leading cause of morbidity and mortality worldwide. Early identification of sepsis is important as it allows timely administration of potentially life-saving resuscitation and antimicrobial therapy. We present COMPOSER (COnformal Multidimensional Prediction Of SEpsis Risk), a deep learning model for the early prediction of sepsis, specifically designed to reduce false alarms by detecting unfamiliar patients/situations arising from erroneous data, missingness, distributional shift and data drifts. COMPOSER flags these unfamiliar cases as indeterminate rather than making spurious predictions. Six patient cohorts (515,720 patients) curated from two healthcare systems in the United States across intensive care units (ICU) and emergency departments (ED) were used to train and externally and temporally validate this model. In a sequential prediction setting, COMPOSER achieved a consistently high area under the curve (AUC) (ICU: 0.925-0.953; ED: 0.938-0.945). Out of over 6 million prediction windows roughly 20% and 8% were identified as indeterminate amongst non-septic and septic patients, respectively. COMPOSER provided early warning within a clinically actionable timeframe (ICU: 12.2 [3.2 22.8] and ED: 2.1 [0.8 4.5] hours prior to first antibiotics order) across all six cohorts, thus allowing for identification and prioritization of patients at high risk for sepsis.

Identifiers

PMID34504260
PMCPMC8429719
OpenAlexW3196930108

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.