Evidence map›Paper›PMID 39569464›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2025

Using human factors methods to mitigate bias in artificial intelligence-based clinical decision support.

Laura G Militello, Julie Diiulio, Debbie L Wilson, Khoa A Nguyen, Christopher A Harle, Walid Gellad, Wei-Hsuan Lo-Ciganic

2 registry-linked trialsAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06806163 narecruitingnot on this map

Machine-Learning Prediction and Reducing Overdoses With EHR Nudges

TypeinterventionalSponsorUniversity of PittsburghRan2025 to 2027Enrolled1,350ConditionsOpioid Overdose, Opioid Use, Opioid Use Disorder, OpioidsArmsEHR-Embedded Elevated-Risk Flag, EHR-Embedded Elevated-Risk Flag with Behavioral Nudges, Usual Care
NCT06810076 naactive not recruitingnot on this map

Developing and Evaluating a Machine-Learning Opioid Prediction & Risk-Stratification E-Platform (DEMONSTRATE)

TypeinterventionalSponsorUniversity of PittsburghRan2025 to 2026Enrolled674ConditionsOpiate Overdose, Opioid-Related Disorders, Narcotic-Related Disorders, Substance-related DisordersArmsMachine Learning-Based Clinical Decision Support: Overdose Prevention Alert (OPA) Intervention
3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Hot topics in artificial intelligence.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Laura G MilitelloApplied Decision Science, LLC, Dayton, OH 45429, United States.ORCID 0000-0001-8445-5640
Julie DiiulioApplied Decision Science, LLC, Dayton, OH 45429, United States.ORCID 0000-0002-5791-0705
Debbie L WilsonDepartment of Pharmaceutical Outcomes & Policy, College of Pharmacy, University of Florida, Gainesville, FL 32610, United States.ORCID 0000-0002-1640-5497
Khoa A NguyenDepartment of Pharmacotherapy & Translational Research, College of Pharmacy, University of Florida, Gainesville, FL 32610, United States.ORCID 0000-0002-0096-0293
Christopher A HarleDepartment of Health Policy and Management, Richard M. Fairbanks School of Public Health, Indiana University, Indianapolis, IN 46202, United States.ORCID 0000-0002-4803-3632
Walid GelladCenter for Pharmaceutical Policy and Prescribing, Health Policy Institute, University of Pittsburgh, Pittsburgh, PA 15261, United States.ORCID 0000-0002-6992-5197
Wei-Hsuan Lo-CiganicCenter for Pharmaceutical Policy and Prescribing, Health Policy Institute, University of Pittsburgh, Pittsburgh, PA 15261, United States.ORCID 0000-0001-6590-4770

Funding

Using Machine Learning to Predict Problematic Prescription Opioid Use and Opioid OverdoseR01DA044985 · NIDA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI Walid F. Gellad · 2017 to 2026
$5.4M
Developing and Evaluating a Machine-Learning Opioid Prediction & Risk-Stratification E-Platform (DEMONSTRATE)R01DA050676 · NIDA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI LO-CIGANIC, WEI-HSUAN JENNY · 2021 to 2025
$3.2M
Nudging Primary Care Providers toward Guideline-Recommended Opioid Prescribing through Easier and More Convenient EHR Information DesignR33DA046085 · NIDA · INDIANA UNIVERSITY INDIANAPOLIS · PI HARLE, CHRISTOPHER ALBERT, MAZURENKO, OLENA · 2019 to 2021
$1.7M
NIDA NIH HHS R01 DA044985NIDA NIH HHS R01 DA050676NIDA NIH HHS R01DA050676NIDA NIH HHS R33 DA046085NIH HHS
6 · The paper itself

Abstract

objectivesTo highlight the often overlooked role of user interface (UI) design in mitigating bias in artificial intelligence (AI)-based clinical decision support (CDS). MATERIALS AND

methodsThis perspective paper discusses the interdependency between AI-based algorithm development and UI design and proposes strategies for increasing the safety and efficacy of CDS.

resultsThe role of design in biasing user behavior is well documented in behavioral economics and other disciplines. We offer an example of how UI designs play a role in how bias manifests in our machine learning-based CDS development. DISCUSSION: Much discussion on bias in AI revolves around data quality and algorithm design; less attention is given to how UI design can exacerbate or mitigate limitations of AI-based applications.

conclusionThis work highlights important considerations including the role of UI design in reinforcing/mitigating bias, human factors methods for identifying issues before an application is released, and risk communication strategies.

Indexed as

Artificial IntelligenceDecision Support Systems, ClinicalErgonomicsUser-Computer InterfaceAlgorithmsBiasHumansMachine Learningartificial intelligencebias mitigationclinical decision supporthuman factors methods

Identifiers

PMID39569464
PMCPMC11756570

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.