Evidence map›Paper›PMID 41587768›Full record

ArticleJMIR AI2026

Evaluating an AI Decision Support System for the Emergency Department: Retrospective Study.

Yvette Van Der Haas, Wiesje Roskamp, Lidwina Elisabeth Maria Chang-Willems, Boudewijn van Dongen, Swetta Jansen, Annemarie de Jong, Renata Medeiros de Carvalho, Dorien Melman, Arjan van de Merwe, Marieke Bastian-Sanders and 4 more

Abstract read
In one paragraph

Article in JMIR AI, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Yvette Van Der Haas *Eindhoven University of Technology, Eindhoven, The Netherlands.ORCID https://orcid.org/0000-0002-0887-3979
Wiesje Roskamp *St. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0007-1241-1279
Lidwina Elisabeth Maria Chang-WillemsSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0003-1988-1901
Boudewijn van DongenEindhoven University of Technology, Eindhoven, The Netherlands.ORCID https://orcid.org/0000-0002-3978-6464
Swetta JansenSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0000-0002-5747-3410
Annemarie de JongSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0001-4155-4355
Renata Medeiros de CarvalhoEindhoven University of Technology, Eindhoven, The Netherlands.ORCID https://orcid.org/0000-0001-6129-9278
Dorien MelmanSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0001-2231-804X
Arjan van de MerweSt. Antonius Ziekenhuis, Utrecht, The Netherlands.
Marieke Bastian-SandersSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0002-1054-2324
Bart OverbeekSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0002-0052-5731
Rogier Leendert Charles PlasSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0000-0002-0612-7905
Marleen VreeburgSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0000-4108-8254
Thomas van DijkSt. Antonius Ziekenhuis, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0005-4221-1150

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundOvercrowding in the emergency department (ED) is a growing challenge, associated with increased medical errors, longer patient stays, higher morbidity, and increased mortality rates. Artificial intelligence (AI) decision support tools have shown potential in addressing this problem by assisting with faster decision-making regarding patient admissions; yet many studies neglect to focus on the clinical relevance and practical applications of these AI solutions.

objectiveThis study aimed to evaluate the clinical relevance of an AI model in predicting patient admission from the ED to hospital wards and its potential impact on reducing the time needed to make an admission decision.

methodsA retrospective study was conducted using anonymized patient data from St. Antonius Hospital, the Netherlands, from January 2018 to September 2023. An Extreme Gradient Boosting AI model was developed and tested on these data of 154,347 visits to predict admission decisions. The model was evaluated using data segmented into 10-minute intervals, which reflected real-world applicability. The primary outcome measured was the reduction in the decision-making time between the AI model and the admission decision made by the clinician. Secondary outcomes analyzed the performance of the model across various subgroups, including the age of the patient, medical specialty, classification category, and time of day.

resultsThe AI model demonstrated a precision of 0.78 and a recall of 0.73, with a median time saving of 111 (IQR 59-169) minutes for true positive predicted patients. Subgroup analysis revealed that older patients and certain specialties such as pulmonology benefited the most from the AI model, with time savings of up to 90 minutes per patient.

conclusionsThe AI model shows significant potential to reduce the time to admission decisions, alleviate ED overcrowding, and improve patient care. The model offers the advantage of always providing weighted advice on admission, even when the ED is under pressure. Future prospective studies are needed to assess the impact in the real world and further enhance the performance of the model in diverse hospital settings.

Indexed as

AIartificial intelligenceclinical impactemergency departmenthealth care

Identifiers

PMID41587768
PMCPMC12887564

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.