Evidence map›Paper›PMID 37172264›Full record

SynthesisJournal of the American Medical Informatics Association : JAMIA2023

Deployment of machine learning algorithms to predict sepsis: systematic review and application of the SALIENT clinical AI implementation framework.

Anton H van der Vegt, Ian A Scott, Krishna Dermawan, Rudolf J Schnetler, Vikrant R Kalke, Paul J Lane

Abstract readSystematic Review
In one paragraph

Synthesis in Journal of the American Medical Informatics Association : JAMIA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 37 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
37citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

37 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Alert fatigue measurement in clinical decision support: a systematic review.Journal of the American Medical Informatics Association : JAMIA · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Anton H van der VegtQueensland Digital Health Centre, The University of Queensland, Brisbane, Queensland, Australia.ORCID 0000-0001-5642-5188
Ian A ScottDepartment of Internal Medicine and Clinical Epidemiology, Princess Alexandra Hospital, Brisbane, Australia.
Krishna DermawanCentre for Information Resilience, The University of Queensland, St Lucia, Australia.
Rudolf J SchnetlerSchool of Information Technology and Electrical Engineering, The University of Queensland, St Lucia, Australia.
Vikrant R KalkePatient Safety and Quality, Clinical Excellence Queensland, Queensland Health, Brisbane, Australia.
Paul J LaneSafety Quality & Innovation, The Prince Charles Hospital, Queensland Health, Brisbane, Australia.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo retrieve and appraise studies of deployed artificial intelligence (AI)-based sepsis prediction algorithms using systematic methods, identify implementation barriers, enablers, and key decisions and then map these to a novel end-to-end clinical AI implementation framework. MATERIALS AND

methodsSystematically review studies of clinically applied AI-based sepsis prediction algorithms in regard to methodological quality, deployment and evaluation methods, and outcomes. Identify contextual factors that influence implementation and map these factors to the SALIENT implementation framework.

resultsThe review identified 30 articles of algorithms applied in adult hospital settings, with 5 studies reporting significantly decreased mortality post-implementation. Eight groups of algorithms were identified, each sharing a common algorithm. We identified 14 barriers, 26 enablers, and 22 decision points which were able to be mapped to the 5 stages of the SALIENT implementation framework. DISCUSSION: Empirical studies of deployed sepsis prediction algorithms demonstrate their potential for improving care and reducing mortality but reveal persisting gaps in existing implementation guidance. In the examined publications, key decision points reflecting real-word implementation experience could be mapped to the SALIENT framework and, as these decision points appear to be AI-task agnostic, this framework may also be applicable to non-sepsis algorithms. The mapping clarified where and when barriers, enablers, and key decisions arise within the end-to-end AI implementation process.

conclusionsA systematic review of real-world implementation studies of sepsis prediction algorithms was used to validate an end-to-end staged implementation framework that has the ability to account for key factors that warrant attention in ensuring successful deployment, and which extends on previous AI implementation frameworks.

Indexed as

Artificial IntelligenceSepsisAdultAlgorithmsEmpirical ResearchHumansMachine LearningAI implementationartificial intelligencemachine learningsepsis predictionsystematic review

Identifiers

PMID37172264
PMCPMC10280361

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.