Evidence map›Paper›PMID 37964688›Full record

SynthesisJournal of the American Medical Informatics Association : JAMIA2024

Systematic review and longitudinal analysis of implementing Artificial Intelligence to predict clinical deterioration in adult hospitals: what is known and what remains uncertain.

Anton H van der Vegt, Victoria Campbell, Imogen Mitchell, James Malycha, Joanna Simpson, Tracy Flenady, Arthas Flabouris, Paul J Lane, Naitik Mehta, Vikrant R Kalke and 4 more

Abstract readSystematic Review
In one paragraph

Synthesis in Journal of the American Medical Informatics Association : JAMIA, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Alert fatigue measurement in clinical decision support: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2026
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Article
  6. Article
  7. Article
  8. Recent Advances in AI and GenAI for Health Informatics.Healthcare (Basel, Switzerland) · 2026
    Review
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Review
  16. Observational
  17. Article
  18. Clinical evaluation of a machine learning-based early warning system for patient deterioration.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2024
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Anton H van der VegtCentre for Health Services Research, The University of Queensland, Brisbane, QLD 4102, Australia.ORCID 0000-0001-5642-5188
Victoria CampbellIntensive Care Unit, Sunshine Coast Hospital and Health Service, Birtynia, QLD 4575, Australia.
Imogen MitchellOffice of Research and Education, Canberra Health Services, Canberra, ACT 2601, Australia.
James MalychaDepartment of Critical Care Medicine, The Queen Elizabeth Hospital, Woodville, SA 5011, Australia.
Joanna SimpsonEastern Health Intensive Care Services, Eastern Health, Box Hill, VIC 3128, Australia.
Tracy FlenadySchool of Nursing, Midwifery & Social Sciences, Central Queensland University, Rockhampton, QLD 4701, Australia.
Arthas FlabourisIntensive Care Department, Royal Adelaide Hospital, Adelaide, SA 5000, Australia.
Paul J LaneSafety Quality & Innovation, The Prince Charles Hospital, Chermside, QLD 4032, Australia.
Naitik MehtaPatient Safety and Quality, Clinical Excellence Queensland, Brisbane, QLD 4001, Australia.
Vikrant R KalkePatient Safety and Quality, Clinical Excellence Queensland, Brisbane, QLD 4001, Australia.
Jovie A DecoynaSchool of Medicine and Dentistry, Griffith University, Gold Coast, QLD 4222, Australia.
Nicholas Es'haghiSchool of Medicine and Dentistry, Griffith University, Gold Coast, QLD 4222, Australia.
Chun-Huei LiuSchool of Medicine and Dentistry, Griffith University, Gold Coast, QLD 4222, Australia.
Ian A ScottCentre for Health Services Research, The University of Queensland, Brisbane, QLD 4102, Australia.

Funding

Advanced Queensland Industry ResearchQueensland Government
6 · The paper itself

Abstract

objectiveTo identify factors influencing implementation of machine learning algorithms (MLAs) that predict clinical deterioration in hospitalized adult patients and relate these to a validated implementation framework. MATERIALS AND

methodsA systematic review of studies of implemented or trialed real-time clinical deterioration prediction MLAs was undertaken, which identified: how MLA implementation was measured; impact of MLAs on clinical processes and patient outcomes; and barriers, enablers and uncertainties within the implementation process. Review findings were then mapped to the SALIENT end-to-end implementation framework to identify the implementation stages at which these factors applied.

resultsThirty-seven articles relating to 14 groups of MLAs were identified, each trialing or implementing a bespoke algorithm. One hundred and seven distinct implementation evaluation metrics were identified. Four groups reported decreased hospital mortality, 1 significantly. We identified 24 barriers, 40 enablers, and 14 uncertainties and mapped these to the 5 stages of the SALIENT implementation framework. DISCUSSION: Algorithm performance across implementation stages decreased between in silico and trial stages. Silent plus pilot trial inclusion was associated with decreased mortality, as was the use of logistic regression algorithms that used less than 39 variables. Mitigation of alert fatigue via alert suppression and threshold configuration was commonly employed across groups.

conclusions: There is evidence that real-world implementation of clinical deterioration prediction MLAs may improve clinical outcomes. Various factors identified as influencing success or failure of implementation can be mapped to different stages of implementation, thereby providing useful and practical guidance for implementers.

Indexed as

Artificial IntelligenceClinical DeteriorationHospitalsAlgorithmsHumansMachine LearningAI implementationartificial intelligenceclinical deterioration predictiondigital healthhealth informaticsmachine learningsystematic review

Identifiers

PMID37964688
PMCPMC10797271

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.