Evidence map›Paper›PMID 32673244›Full record

ArticleJMIR medical informatics2020

Real-World Integration of a Sepsis Deep Learning Technology Into Routine Clinical Care: Implementation Study.

Mark P Sendak, William Ratliff, Dina Sarro, Elizabeth Alderton, Joseph Futoma, Michael Gao, Marshall Nichols, Mike Revoir, Faraz Yashar, Corinne Miller and 17 more

Open access · goldAbstract read
In one paragraph

Article in JMIR medical informatics, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 134 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
134citing papers in PubMed, 4 pooled it
9.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

134 citing papers in PubMed, 4 syntheses or guidelines pooled it, 206 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. The benefits and future potential of generative artificial intelligence (GAI) on mental health: a Delphi study.International journal of qualitative studies on health and well-being · 2026
    Article
  6. Review
  7. Article
  8. AI In Leukemia Diagnostics: Complementing the Pathologist's Role.International journal of laboratory hematology · 2026
    Review
  9. Article
  10. Article
  11. A pragmatic risk-stratified framework for using large language models in intensive care medicine: A narrative review.Critical care and resuscitation : journal of the Australasian Academy of Critical Care Medicine · 2026
    Review
  12. Article
  13. Review
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article

74 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

27 authors at 7 institutions in 1 country.

Mark P SendakDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0001-5828-4497
William RatliffDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0003-4015-3805
Dina SarroDuke University Hospital, Durham, NC, United States.ORCID https://orcid.org/0000-0001-9749-1317
Elizabeth AldertonDuke University Hospital, Durham, NC, United States.ORCID https://orcid.org/0000-0002-6886-1988
Joseph FutomaDepartment of Statistics, Duke University, Durham, NC, United States.ORCID https://orcid.org/0000-0003-2744-232X
Michael GaoDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0003-0534-4403
Marshall NicholsDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0002-0969-1982
Mike RevoirDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0003-1834-9078
Faraz YasharDepartment of Statistics, Duke University, Durham, NC, United States.ORCID https://orcid.org/0000-0001-8487-5151
Corinne MillerDuke University Hospital, Durham, NC, United States.ORCID https://orcid.org/0000-0001-9020-9825
Kelly KesterDuke University Hospital, Durham, NC, United States.ORCID https://orcid.org/0000-0002-5822-4977
Sahil SandhuDuke University, Durham, NC, United States.ORCID https://orcid.org/0000-0001-6458-5253
Kristin CoreyDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0002-7158-1215
Nathan BrajerDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0002-8803-2116
Christelle TanDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0001-6563-5558
Anthony LinDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0001-9548-6194
Tres BrownDuke Health Technology Solutions, Durham, NC, United States.ORCID https://orcid.org/0000-0002-0891-6705
Susan EngelboschDuke Health Technology Solutions, Durham, NC, United States.ORCID https://orcid.org/0000-0001-7445-3457
Kevin AnstromDuke Clinical Research Institute, Durham, NC, United States.ORCID https://orcid.org/0000-0001-6452-2172
Madeleine Clare ElishData & Society, New York, NY, United States.ORCID https://orcid.org/0000-0002-9647-1178
Katherine HellerDepartment of Statistics, Duke University, Durham, NC, United States.ORCID https://orcid.org/0000-0002-4848-7466
Rebecca DonohoeDivision of Emergency Medicine, Duke University School of Medicine, Durham, NC, United States.ORCID https://orcid.org/0000-0003-4392-0619
Jason TheilingDivision of Emergency Medicine, Duke University School of Medicine, Durham, NC, United States.ORCID https://orcid.org/0000-0003-0357-5486
Eric PoonDuke Health Technology Solutions, Durham, NC, United States.ORCID https://orcid.org/0000-0002-7251-5842
Suresh BaluDuke Institute for Health Innovation, Durham, NC, United States.ORCID https://orcid.org/0000-0003-4929-9130
Armando BedoyaDuke Health Technology Solutions, Durham, NC, United States.ORCID https://orcid.org/0000-0001-6496-7024
Cara O'BrienDepartment of Medicine, Duke University School of Medicine, Durham, NC, United States.ORCID https://orcid.org/0000-0002-5519-7344
Duke University · USDuke Institute for Health Innovation · USDuke University Hospital · USClinical Research Institute · USData & Society Research Institute · USGoogle (United States) · USHarvard University · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundSuccessful integrations of machine learning into routine clinical care are exceedingly rare, and barriers to its adoption are poorly characterized in the literature.

objectiveThis study aims to report a quality improvement effort to integrate a deep learning sepsis detection and management platform, Sepsis Watch, into routine clinical care.

methodsIn 2016, a multidisciplinary team consisting of statisticians, data scientists, data engineers, and clinicians was assembled by the leadership of an academic health system to radically improve the detection and treatment of sepsis. This report of the quality improvement effort follows the learning health system framework to describe the problem assessment, design, development, implementation, and evaluation plan of Sepsis Watch.

resultsSepsis Watch was successfully integrated into routine clinical care and reshaped how local machine learning projects are executed. Frontline clinical staff were highly engaged in the design and development of the workflow, machine learning model, and application. Novel machine learning methods were developed to detect sepsis early, and implementation of the model required robust infrastructure. Significant investment was required to align stakeholders, develop trusting relationships, define roles and responsibilities, and to train frontline staff, leading to the establishment of 3 partnerships with internal and external research groups to evaluate Sepsis Watch.

conclusionsMachine learning models are commonly developed to enhance clinical decision making, but successful integrations of machine learning into routine clinical care are rare. Although there is no playbook for integrating deep learning into clinical care, learnings from the Sepsis Watch integration can inform efforts to develop machine learning technologies at other health care delivery systems.

Indexed as

changedeep learninginnovation, organizationalmachine learningsepsistranslational medicine

Identifiers

PMID32673244
PMCPMC7391165
OpenAlexW2998524378

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.