Evidence map›Paper›PMID 41184886›Full record

Observational studyBMC medical informatics and decision making2025

From prediction to action: a retrospective observational study on the real-world implementation of Critical Interventions (CrIs), an AI-based clinical decision support system changing clinical behavior in the emergency department.

Hansol Chang, Jae Yong Yu, Hyunjung Park, Yee Jun Song, Sejin Heo, Jong Eun Park, Gun Tak Lee, Se Uk Lee, Taerim Kim, Hee Yoon and 2 more

Abstract readObservational Study
In one paragraph

Observational study in BMC medical informatics and decision making, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Hansol ChangDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Jae Yong YuResearch Institute for Data Science and AI (Artificial Intelligence), Hallym University, Chuncheon-si, Gangwon-do, Republic of Korea.
Hyunjung ParkKPMG, 152 Teheran-ro Gangnam-gu, Seoul, 06236, Republic of Korea.
Yee Jun SongDepartment of Digital Health, Samsung Advanced Institute for Health Science & Technology (SAIHST), Sungkyunkwan University, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Sejin HeoDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Jong Eun ParkDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Gun Tak LeeDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Se Uk LeeDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Taerim KimDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Hee YoonDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Sung Yeon HwangDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea.
Won Chul ChaDepartment of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, 115 Irwon-ro Gangnam-gu, Seoul, 06355, Republic of Korea. docchaster@gmail.com.

Funding

National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIT) No.2022R1A2C3004595
6 · The paper itself

Abstract

backgroundOptimal emergency department (ED) care for critically ill patients relies on prompt recognition and initiation of necessary interventions. The Critical Interventions (CrIs) system was designed to predict the need for urgent procedures, including arterial line insertion, oxygen therapy, high-flow nasal cannula (HFNC), intubation, and inotropes or vasopressors, based solely on triage data. This study aimed to evaluate the effectiveness of the CrIs system in enhancing clinical decision-making and reducing time to intervention, as well as to assess user satisfaction post-implementation.

methodA retrospective observational study was conducted at a tertiary hospital in South Korea, comparing time to interventions and outcomes between pre- and post-implementation phases of CrIs. The system's predictive performance was analyzed using the area under the receiver operating characteristic curve (AUROC). Additionally, user feedback was collected through surveys.

resultsThe study included 37,632 ED visits, with notable predictive performance for CrIs across various interventions (AUROC: 0.879 for arterial lines, 0.906 for oxygen therapy, 0.95 for HFNC, 0.928 for intubation, and 0.88 for inotropes/vasopressors). Post-implementation, significant reductions were observed in the median time to intervention for A-lines, oxygen therapy, and HFNC. Survey responses highlighted overall satisfaction with CrIs, though suggestions for interface improvements were noted.

conclusionThe CrIs system demonstrated robust predictive accuracy and significantly reduced time to critical interventions, enhancing ED operational efficiency. Future enhancements should focus on improving user interface and communication features to maximize system utility. CLINICAL TRIAL NUMBER: Not applicable.

Indexed as

Artificial IntelligenceClinical Decision-MakingCritical CareDecision Support Systems, ClinicalEmergency Service, HospitalAdultAgedFemaleHumansMaleMiddle AgedRepublic of KoreaRetrospective StudiesArtificial intelligenceClinical decision support systemsCritical careEmergency departmentImplementation science

Identifiers

PMID41184886
PMCPMC12581481

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.