Evidence map›Paper›PMID 40639839›Full record

ArticleBMJ health & care informatics2025

Bias in vital signs? Machine learning models can learn patients' race or ethnicity from the values of vital signs alone.

Bojana Velichkovska, Hristijan Gjoreski, Daniel Denkovski, Marija Kalendar, Irene Dankwa Mullan, Judy Wawira Gichoya, Nicole Martinez, Leo Celi, Venet Osmani

Abstract readMulticenter Study
In one paragraph

Article in BMJ health & care informatics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Bojana VelichkovskaSs Cyril and Methodius University in Skopje, Skopje, North Macedonia.
Hristijan GjoreskiSs Cyril and Methodius University in Skopje, Skopje, North Macedonia.
Daniel DenkovskiSs Cyril and Methodius University in Skopje, Skopje, North Macedonia.
Marija KalendarSs Cyril and Methodius University in Skopje, Skopje, North Macedonia.
Irene Dankwa MullanMilken Institute School of Public Health, George Washington University, Washington, District of Columbia, USA.
Judy Wawira GichoyaEmory School of Medicine, Emory University, Atlanta, Georgia, USA.
Nicole MartinezStanford University School of Medicine, Stanford University, Stanford, California, USA.
Leo CeliInstitute of Medical Engineering and Science, Massachusetts Institute of Technology, Boston, Massachusetts, USA.
Venet OsmaniDigital Environment Research Institute, Queen Mary University of London, London, UK v.osmani@qmul.ac.uk.ORCID http://orcid.org/0000-0001-7306-2972

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesTo investigate whether machine learning (ML) algorithms can learn racial or ethnic information from the vital signs alone.

methodsA retrospective cohort study of critically ill patients between 2014 and 2015 from the multicentre eICU-CRD critical care database involving 335 intensive care units in 208 US hospitals, containing 200 859 admissions. We extracted 10 763 critical care admissions of patients aged 18 and over, alive during the first 24 hours after admission, with recorded race or ethnicity as well as at least two measurements of heart rate, oxygen saturation, respiratory rate and blood pressure. Pairs of subgroups were matched based on age, gender, admission diagnosis and disease severity. XGBoost, Random Forest and Logistic Regression algorithms were used to predict recorded race or ethnicity based on the values of vital signs.

resultsModels derived from only four vital signs can predict patients' recorded race or ethnicity with an area under the curve (AUC) of 0.74 (±0.030) between White and Black patients, AUC of 0.74 (±0.030) between Hispanic and Black patients and AUC of 0.67 (±0.072) between Hispanic and White patients, even when controlling for known factors. There were very small, but statistically significant differences between heart rate, oxygen saturation and blood pressure, but not respiration rate and invasively measured oxygen saturation. DISCUSSION: ML algorithms can extract racial or ethnicity information from vital signs alone across diverse patient populations, even when controlling for known biases such as pulse oximetry variations and comorbidities. The model correctly classified the race or ethnicity in two out of three patients, indicating that this outcome is not random.

conclusionVital signs embed racial information that can be learnt by ML algorithms, posing a significant risk to equitable clinical decision-making. Mitigating measures might be challenging, considering the fundamental role of vital signs in clinical decision-making.

Indexed as

EthnicityMachine LearningRacial GroupsVital SignsAdultAgedAlgorithmsBiasCritical IllnessFemaleHeart RateHumansIntensive Care UnitsMaleMiddle AgedRespiratory RateArtificial intelligenceDecision Support Systems, ClinicalElectronic Health RecordsHealth Equity

Identifiers

PMID40639839
PMCPMC12258377

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.