Evidence map›Paper›PMID 41719163›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2026

Factors influencing the effectiveness of artificial intelligence-assisted decision-making in medicine: a scoping review.

Nicholas J Jackson, Katherine E Brown, Rachael Miller, Matthew Murrow, Michael R Cauley, Benjamin X Collins, Laurie L Novak, Natalie C Benda, Jessica S Ancker

Abstract readScoping Review
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Explainability in context: calibrating appropriate trust and reliance in artificial intelligence.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  3. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

9 authors.

Nicholas J JacksonDepartment of Biomedical Informatics, Vanderbilt University, Nashville, TN 37203, United States.ORCID 0000-0001-6763-599X
Katherine E BrownDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.ORCID 0000-0003-4443-8541
Rachael MillerDepartment of Biomedical Informatics, Vanderbilt University, Nashville, TN 37203, United States.
Matthew MurrowDepartment of Biomedical Informatics, Vanderbilt University, Nashville, TN 37203, United States.
Michael R CauleyDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.ORCID 0000-0003-3835-2725
Benjamin X CollinsDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.ORCID 0000-0002-6884-3819
Laurie L NovakDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
Natalie C BendaSchool of Nursing, Columbia University, New York City, NY 10032, United States.ORCID 0000-0002-3256-0243
Jessica S AnckerDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.ORCID 0000-0002-3859-9130

Funding

Vanderbilt Biomedical Informatics Training ProgramT15LM007450 · NLM · VANDERBILT UNIVERSITY · PI Jessica S. Ancker, Bradley A. Malin · 2002 to 2026
$19.7M
"Maternal Outcome Monitoring and Support (MOMS) - A mHealth symptom self-monitoring and decision support system to reduce racial and ethnic disparities in postpartum outcomesR00MD015781 · NIMHD · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI BENDA, NATALIE CHRISTINE · 2023 to 2025
$732k
AHRQ HHS T32 HS026122AHRQ HHS T32HS026122NIMHD NIH HHS R00 MD015781NIMHD NIH HHS R00MD015781NLM NIH HHS T15 LM007450NLM NIH HHS T15LM007450
6 · The paper itself

Abstract

objectivesResearch on artificial intelligence (AI)-based clinical decision-support (AI-CDS) systems has returned mixed results. Sometimes providing AI-CDS to a clinician will improve decision-making performance, sometimes it will not, and it is not always clear why. This scoping review seeks to clarify existing evidence by identifying clinician-level and technology design factors that impact the effectiveness of AI-assisted decision-making in medicine. MATERIALS AND

methodsWe searched MEDLINE, Web of Science, and Embase for peer-reviewed papers that studied factors impacting the effectiveness of AI-CDS. We identified the factors studied and their impact on 3 outcomes: clinicians' attitudes toward AI, their decisions (eg, acceptance rate of AI recommendations), and their performance when utilizing AI-CDS.

resultsWe retrieved 5850 articles and included 45. Four clinician-level and technology design factors were commonly studied. Expert clinicians may benefit less from AI-CDS than nonexperts, with some mixed results. Explainable AI increased clinicians' trust, but could also increase trust in incorrect AI recommendations, potentially harming human-AI collaborative performance. Clinicians' baseline attitudes toward AI predict their acceptance rates of AI recommendations. Of the 3 outcomes of interest, human-AI collaborative performance was most commonly assessed. DISCUSSION AND

conclusionFew factors have been studied for their impact on the effectiveness of AI-CDS. Due to conflicting outcomes between studies, we recommend future work should leverage the concept of "appropriate trust" to facilitate more robust research on AI-CDS, aiming not to increase overall trust in or acceptance of AI but to ensure that clinicians accept AI recommendations only when trust in AI is warranted.

Indexed as

Artificial IntelligenceAttitude of Health PersonnelClinical Decision-MakingDecision Support Systems, ClinicalAttitude to ComputersHumansTrustartificial intelligencehuman–computer interactionmedical decision-makingreview

Identifiers

PMID41719163
PMCPMC13127661

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.