Evidence map›Paper›PMID 41748705›Full record

ArticleNPJ digital medicine2026

Vision-Enabled AI scribes reduce omissions in clinical conversations: evidence from simulated medication histories.

Bradley D Menz, Nicholas L Scarfo, Natansh D Modi, Erik Cornelisse, Lee X Li, Jin Quan Eugene Tan, Jimit Gandhi, Dorsa Maher, Dib Kousa, Kezia Daniel and 7 more

Abstract read
In one paragraph

Article in NPJ digital medicine, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Bradley D MenzCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia. Bradley.menz@flinders.edu.au.ORCID http://orcid.org/0000-0002-0855-5081
Nicholas L ScarfoSA Pharmacy, Southern Adelaide Local Health Network, Adelaide, South Australia.
Natansh D ModiClinical and Health Sciences, Adelaide, University of South Australia, Adelaide, South Australia.
Erik CornelisseCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia.
Lee X LiCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia.
Jin Quan Eugene TanCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia.
Jimit GandhiClinical and Health Sciences, Adelaide, University of South Australia, Adelaide, South Australia.
Dorsa MaherCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia.
Dib KousaSA Pharmacy, Southern Adelaide Local Health Network, Adelaide, South Australia.
Kezia DanielSA Pharmacy, Central Adelaide Local Health Network, Adelaide, South Australia.
Vidya MenonSA Pharmacy, Southern Adelaide Local Health Network, Adelaide, South Australia.
Stephen BacchiDepartment of Neurology, Northern Adelaide Local Health Network, Adelaide, South Australia.
Ross A McKinnonCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia.
Michael D WieseClinical and Health Sciences, Adelaide, University of South Australia, Adelaide, South Australia.
Andrew RowlandCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia.
Michael J SorichCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia.
Ashley M HopkinsCollege of Medicine and Public Health, Flinders Health and Medical Research Institute, Flinders University, Adelaide, South Australia.

Funding

National Health and Medical Research Council APP2008119National Health and Medical Research Council APP2030913
6 · The paper itself

Abstract

Most ambient AI medical scribes process audio only, omitting clinically important visual details. We developed a vision-enabled AI scribe using Google's Gemini model and Ray-Ban Meta smart glasses to document medication histories-a task requiring both audio and visual input. Ten clinical pharmacists video-recorded 110 simulated medication history interviews. Following iterative prompt engineering on 10 training recordings, the scribe was evaluated on 100 test recordings (2160 data points) across patient details and medication-specific fields. The vision-enabled scribe achieved 98% overall accuracy (2114/2,160 data points), ranging from 96% for patient details to 99% for dosing directions and indication. Video input significantly outperformed audio-only processing (98% vs 81%, P < 0.001), primarily through reduced omissions (10 vs 358 errors). Vision-enabled AI scribes substantially improved documentation accuracy for tasks requiring visual input, demonstrating potential to markedly reduce omission errors in clinical documentation.

Identifiers

PMID41748705
PMCPMC13057267

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.