Evidence map›Paper›PMID 40038550›Full record

ArticleCommunications medicine2025

Physician clinical decision modification and bias assessment in a randomized controlled trial of AI assistance.

Ethan Goh, Bryan Bunning, Elaine C Khoong, Robert J Gallo, Arnold Milstein, Damon Centola, Jonathan H Chen

Abstract read
In one paragraph

Article in Communications medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Review
  14. Review
  15. Review
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Ethan GohStanford Biomedical Informatics Research, Stanford University, Stanford, CA, USA. ethangoh@stanford.edu.ORCID http://orcid.org/0009-0001-7491-4257
Bryan BunningStanford Biomedical Informatics Research, Stanford University, Stanford, CA, USA.
Elaine C KhoongDivision of General Internal Medicine (DGIM) at ZSFG, Department of Medicine, UCSF, San Francisco, CA, USA.ORCID http://orcid.org/0000-0002-2514-3572
Robert J GalloStanford Biomedical Informatics Research, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0002-2601-0173
Arnold MilsteinStanford Clinical Excellence Research Center, Stanford University, Stanford, CA, USA.
Damon CentolaCommunication, Sociology and Engineering, University of Pennsylvania, Pennsylvania, PA, USA.ORCID http://orcid.org/0000-0002-8084-2333
Jonathan H ChenStanford Biomedical Informatics Research, Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0002-4387-8740

Funding

Stanford Center for Clinical and Translational Research and EducationUM1TR004921 · NCATS · STANFORD UNIVERSITY · PI MANISHA DESAI, DEAN W FELSHER · 2024 to 2026
$30.1M
NCATS NIH HHS UM1 TR004921
6 · The paper itself

Abstract

backgroundArtificial intelligence assistance in clinical decision making shows promise, but concerns exist about potential exacerbation of demographic biases in healthcare. This study aims to evaluate how physician clinical decisions and biases are influenced by AI assistance in a chest pain triage scenario.

methodsA randomized, pre post-intervention study was conducted with 50 US-licensed physicians who reviewed standardized chest pain video vignettes featuring either a white male or Black female patient. Participants answered clinical questions about triage, risk assessment, and treatment before and after receiving GPT-4 generated recommendations. Clinical decision accuracy was evaluated against evidence-based guidelines.

resultsHere we show that physicians are willing to modify their clinical decisions based on GPT-4 assistance, leading to improved accuracy scores from 47% to 65% in the white male patient group and 63% to 80% in the Black female patient group. The accuracy improvement occurs without introducing or exacerbating demographic biases, with both groups showing similar magnitudes of improvement (18%). A post-study survey indicates that 90% of physicians expect AI tools to play a significant role in future clinical decision making.

conclusionsPhysician clinical decision making can be augmented by AI assistance while maintaining equitable care across patient demographics. These findings suggest a path forward for AI clinical decision support that improves medical care without amplifying healthcare disparities.

Identifiers

PMID40038550
PMCPMC11880198

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.