Evidence map›Paper›PMID 41083204›Full record

ArticleEmergency medicine journal : EMJ2025

Evaluating the impact of AI assistance on decision-making in emergency doctors interpreting chest X-rays: a multi-reader multi-case study.

David Lyell, Michael Dinh, Mark Gillett, Nidhi Abraham, Emily Rose Symes, Anindya Pradipta Susanto, Bashir Antoine Chakar, Radhika V Seimon, Enrico Coiera, Farah Magrabi

Abstract read
In one paragraph

Article in Emergency medicine journal : EMJ, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

David LyellAustralian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia david.lyell@mq.edu.au.ORCID http://orcid.org/0000-0002-2695-0368
Michael DinhEmergency Department, Royal Prince Alfred Hospital, Sydney Local Health District, Sydney, New South Wales, Australia.
Mark GillettEmergency Department, Royal North Shore Hospital, Northern Sydney Local Health District, Sydney, New South Wales, Australia.
Nidhi AbrahamEmergency Department, Royal Prince Alfred Hospital, Sydney Local Health District, Sydney, New South Wales, Australia.
Emily Rose SymesRPA Green Light Institute for Emergency Care, Sydney Local Health District, Sydney, New South Wales, Australia.
Anindya Pradipta SusantoAustralian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia.ORCID http://orcid.org/0000-0001-5155-6904
Bashir Antoine ChakarRPA Green Light Institute for Emergency Care, Sydney Local Health District, Sydney, New South Wales, Australia.ORCID http://orcid.org/0009-0000-0571-5222
Radhika V SeimonRPA Green Light Institute for Emergency Care, Sydney Local Health District, Sydney, New South Wales, Australia.ORCID http://orcid.org/0000-0002-3903-4801
Enrico CoieraAustralian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia.
Farah MagrabiAustralian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia.ORCID http://orcid.org/0000-0002-8426-5588

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundArtificial intelligence (AI) tools could assist emergency doctors interpreting chest X-rays to inform urgent care. However, the impact of AI assistance on clinical decision-making, a precursor to enhanced care and patient outcomes, remains understudied. This study evaluates the effect of AI assistance on clinical decisions of emergency doctors interpreting chest X-rays.

methodJunior and senior residents, emergency registrars and consultants working in Australian emergency departments were eligible. Doctors completed 18 clinical vignettes involving chest X-ray interpretation, representative of typical patient presentations. Vignettes were randomly selected from a bank of 49 based on the emergency medicine curriculum and contained a chest X-ray, presenting complaint, relevant symptoms and observations. Of the 18 vignettes, each doctor was randomly assigned to have half assisted by a commercial AI tool capable of detecting 124 different chest X-ray findings. Four vignettes contained X-rays known to produce incorrect AI findings. Primary outcomes were correct diagnosis and patient management. X-ray interpretation time, confidence of diagnosis, perceptions about the AI tool and the differential impact of AI assistance by seniority were also examined.

results200 doctors participated. AI assistance increased correct diagnosis by 5.9% (95% CI 2.7 to 9.2%) compared with unassisted vignettes, with the largest increase among senior residents (11.8%; 95% CI 5.2% to 18.3%). Patient management increased by 3.2% (95% CI 0.1% to 6.4%). Confidence in diagnosis increased by 5% (95% CI 3.4% to 6.6%; p<0.001) and interpretation time increased by 4.9 s (p=0.08). Incorrect AI findings decreased correct diagnosis by 1% for false-positive (p=0.9) and 9% for false-negative findings (p=0.1). Participants found the AI tool helpful for interpreting chest X-rays, highlighting missed findings, but were neutral on its accuracy.

conclusionImprovements in diagnosis and patient management without meaningful increases in interpretation time suggest AI assistance could benefit clinical decisions involving chest X-ray interpretation. Further studies are required to ascertain if such improvements translate to improved patient care.

Indexed as

Artificial IntelligenceClinical Decision-MakingEmergency MedicinePhysiciansRadiography, ThoracicAdultAustraliaClinical CompetenceEmergency Service, HospitalFemaleHumansMaleArtificial IntelligencediagnosisEmergency MedicineMachine Learningx-ray

Identifiers

PMID41083204
PMCPMC12703329

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.