Evidence map›Paper›PMID 30128552›Full record

ArticleJAMA internal medicine2018

Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data.

Milena A Gianfrancesco, Suzanne Tamang, Jinoos Yazdany, Gabriela Schmajuk

Registry-linked trialAbstract read
In one paragraph

Article in JAMA internal medicine, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06792890 (A Randomized Controlled Trial of Two Ambient Artificial Intelligence Scribe Technologies to Improve Documentation Efficiency and Reduce Physician Burnout), which is not on this map. Cited by 580 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
580citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06792890 nacompletednot on this mapstarted 2024, after this paper: background citation

A Randomized Controlled Trial of Two Ambient Artificial Intelligence Scribe Technologies to Improve Documentation Efficiency and Reduce Physician Burnout

TypeinterventionalSponsorUniversity of California, Los AngelesRan2024 to 2025Enrolled238ConditionsPhysician Workflow, Artificial Intelligence (AI)ArmsUse Nabla AI Scribe tool provided, Use AI Scribe tool provided by Vendor B
3 · Its place in the literature

Who cites it

580 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Trial
  8. Trial
  9. Review
  10. Article
  11. Predicting Psychiatric Readmission of Children and Adolescents Using Machine Learning.Journal of child and adolescent psychopharmacology · 2026
    Article
  12. Addressing Health Disparities through Community Engagement in Artificial Intelligence-Driven Prevention Science.Prevention science : the official journal of the Society for Prevention Research · 2026
    Review
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Review
  20. Article

520 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Milena A GianfrancescoDivision of Rheumatology, Department of Medicine, University of California, San Francisco.
Suzanne TamangCenter for Population Health Sciences, Stanford University, Palo Alto, California.
Jinoos YazdanyDivision of Rheumatology, Department of Medicine, University of California, San Francisco.
Gabriela SchmajukDivision of Rheumatology, Department of Medicine, University of California, San Francisco.

Funding

RESOURCE-BASED CENTER FOR THE ADVANCEMENT OF PRECISION MEDICINE IN RHEUMATOLOGYP30AR070155 · NIAMS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Mary C Nakamura · 2016 to 2026
$8.2M
Advancing Quality and Outcomes Measurement in RheumatologyK24AR074534 · NIAMS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Jinoos Yazdany · 2019 to 2026
$1.5M
ASPIRE: Advancing Safety Process Innovation in RheumatologyR01HS024412 · AHRQ · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI YAZDANY, JINOOS · 2015 to 2017
$1.4M
A rational approach to liver toxicity monitoring in methotrexate usersK23AR063770 · NIAMS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI SCHMAJUK, GABRIELA · 2013 to 2017
$670k
Examining the causal effect of sociodemographic and genetic factors on patient safety outcomes in individuals prescribed high-risk immunosuppressive medicationsF32AR070585 · NIAMS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI GIANFRANCESCO, MILENA ANNE · 2017 to 2018
$125k
AHRQ HHS R01 HS024412NIAMS NIH HHS F32 AR070585NIAMS NIH HHS K23 AR063770NIAMS NIH HHS K24 AR074534NIAMS NIH HHS P30 AR070155
6 · The paper itself

Abstract

A promise of machine learning in health care is the avoidance of biases in diagnosis and treatment; a computer algorithm could objectively synthesize and interpret the data in the medical record. Integration of machine learning with clinical decision support tools, such as computerized alerts or diagnostic support, may offer physicians and others who provide health care targeted and timely information that can improve clinical decisions. Machine learning algorithms, however, may also be subject to biases. The biases include those related to missing data and patients not identified by algorithms, sample size and underestimation, and misclassification and measurement error. There is concern that biases and deficiencies in the data used by machine learning algorithms may contribute to socioeconomic disparities in health care. This Special Communication outlines the potential biases that may be introduced into machine learning-based clinical decision support tools that use electronic health record data and proposes potential solutions to the problems of overreliance on automation, algorithms based on biased data, and algorithms that do not provide information that is clinically meaningful. Existing health care disparities should not be amplified by thoughtless or excessive reliance on machines.

Indexed as

AlgorithmsElectronic Health RecordsMachine LearningHealthcare DisparitiesHumansSocioeconomic Factors

Identifiers

PMID30128552
PMCPMC6347576

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.