Evidence map›Paper›PMID 33176085›Full record

ArticleThe New England journal of medicine2020

Automated Identification of Adults at Risk for In-Hospital Clinical Deterioration.

Gabriel J Escobar, Vincent X Liu, Alejandro Schuler, Brian Lawson, John D Greene, Patricia Kipnis

Abstract readComparative Study
In one paragraph

Article in The New England journal of medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 153 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
153citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

153 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Review
  13. Observational
  14. Article
  15. Article
  16. Article
  17. "We Don't Want to Cry Wolf": A Qualitative Study About Nurses' Experiences Activating Rapid Response Teams.The Canadian journal of nursing research = Revue canadienne de recherche en sciences infirmieres · 2026
    Article
  18. Article
  19. Article
  20. Article

93 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

6 authors.

Gabriel J EscobarFrom the Systems Research Initiative, Kaiser Permanente Division of Research, Oakland (G.J.E., V.X.L., A.S., B.L., J.D.G., P.K.), the Intensive Care Unit, Kaiser Permanente Medical Center, Santa Clara (V.X.L.), and Unlearn.AI, San Francisco (A.S.) - all in California.
Vincent X LiuFrom the Systems Research Initiative, Kaiser Permanente Division of Research, Oakland (G.J.E., V.X.L., A.S., B.L., J.D.G., P.K.), the Intensive Care Unit, Kaiser Permanente Medical Center, Santa Clara (V.X.L.), and Unlearn.AI, San Francisco (A.S.) - all in California.
Alejandro SchulerFrom the Systems Research Initiative, Kaiser Permanente Division of Research, Oakland (G.J.E., V.X.L., A.S., B.L., J.D.G., P.K.), the Intensive Care Unit, Kaiser Permanente Medical Center, Santa Clara (V.X.L.), and Unlearn.AI, San Francisco (A.S.) - all in California.
Brian LawsonFrom the Systems Research Initiative, Kaiser Permanente Division of Research, Oakland (G.J.E., V.X.L., A.S., B.L., J.D.G., P.K.), the Intensive Care Unit, Kaiser Permanente Medical Center, Santa Clara (V.X.L.), and Unlearn.AI, San Francisco (A.S.) - all in California.
John D GreeneFrom the Systems Research Initiative, Kaiser Permanente Division of Research, Oakland (G.J.E., V.X.L., A.S., B.L., J.D.G., P.K.), the Intensive Care Unit, Kaiser Permanente Medical Center, Santa Clara (V.X.L.), and Unlearn.AI, San Francisco (A.S.) - all in California.
Patricia KipnisFrom the Systems Research Initiative, Kaiser Permanente Division of Research, Oakland (G.J.E., V.X.L., A.S., B.L., J.D.G., P.K.), the Intensive Care Unit, Kaiser Permanente Medical Center, Santa Clara (V.X.L.), and Unlearn.AI, San Francisco (A.S.) - all in California.

Funding

POSTDOCTORAL TRAINING IN MEDICAL INFORMATION SCIENCEST15LM007033 · NLM · STANFORD UNIVERSITY · PI SYLVIA KATINA PLEVRITIS · 1985 to 2026
$25.5M
Identifying pre-sepsis opportunities for early, targeted intervention - Equipment SupplementR35GM128672 · NIGMS · KAISER FOUNDATION RESEARCH INSTITUTE · PI Vincent Liu · 2018 to 2026
$4.3M
Cancer Systems Biology Scholars ProgramR25CA180993 · NCI · STANFORD UNIVERSITY · PI PLEVRITIS, SYLVIA KATINA · 2014 to 2018
$2.2M
Rapid Clinical Snapshots from the EMR among Pneumonia PatientsR01HS018480 · AHRQ · KAISER FOUNDATION RESEARCH INSTITUTE · PI ESCOBAR, GABRIEL J. · 2009 to 2011
$1.5M
Data-driven Precision medicine in sepsisK23GM112018 · NIGMS · KAISER FOUNDATION RESEARCH INSTITUTE · PI LIU, VINCENT · 2014 to 2017
$768k
Agency for Healthcare Research and Quality 1R01HS018480-01AHRQ HHS R01 HS018480Gordon and Betty Moore Foundation 2663Gordon and Betty Moore Foundation 2663.01NCI NIH HHS R25 CA180993NIGMS NIH HHS K23 GM112018NIGMS NIH HHS R35 GM128672NIH HHS K23GM112018NIH HHS R35GM128672NLM NIH HHS T15 LM007033
6 · The paper itself

Abstract

backgroundHospitalized adults whose condition deteriorates while they are in wards (outside the intensive care unit [ICU]) have considerable morbidity and mortality. Early identification of patients at risk for clinical deterioration has relied on manually calculated scores. Outcomes after an automated detection of impending clinical deterioration have not been widely reported.

methodsOn the basis of a validated model that uses information from electronic medical records to identify hospitalized patients at high risk for clinical deterioration (which permits automated, real-time risk-score calculation), we developed an intervention program involving remote monitoring by nurses who reviewed records of patients who had been identified as being at high risk; results of this monitoring were then communicated to rapid-response teams at hospitals. We compared outcomes (including the primary outcome, mortality within 30 days after an alert) among hospitalized patients (excluding those in the ICU) whose condition reached the alert threshold at hospitals where the system was operational (intervention sites, where alerts led to a clinical response) with outcomes among patients at hospitals where the system had not yet been deployed (comparison sites, where a patient's condition would have triggered a clinical response after an alert had the system been operational). Multivariate analyses adjusted for demographic characteristics, severity of illness, and burden of coexisting conditions.

resultsThe program was deployed in a staggered fashion at 19 hospitals between August 1, 2016, and February 28, 2019. We identified 548,838 non-ICU hospitalizations involving 326,816 patients. A total of 43,949 hospitalizations (involving 35,669 patients) involved a patient whose condition reached the alert threshold; 15,487 hospitalizations were included in the intervention cohort, and 28,462 hospitalizations in the comparison cohort. Mortality within 30 days after an alert was lower in the intervention cohort than in the comparison cohort (adjusted relative risk, 0.84, 95% confidence interval, 0.78 to 0.90; P<0.001).

conclusionsThe use of an automated predictive model to identify high-risk patients for whom interventions by rapid-response teams could be implemented was associated with decreased mortality. (Funded by the Gordon and Betty Moore Foundation and others.).

Indexed as

Clinical DeteriorationHospitalizationModels, TheoreticalAdultAgedAlert Fatigue, Health PersonnelAutomationElectronic Health RecordsFemaleHospital MortalityHumansLaboratory Critical ValuesLength of StayMaleMiddle AgedMultivariate Analysis

Identifiers

PMID33176085
PMCPMC7787261

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.