Evidence map›Paper›PMID 38239408›Full record

ArticleCritical care explorations2024

Evaluating Prognostic Bias of Critical Illness Severity Scores Based on Age, Sex, and Primary Language in the United States: A Retrospective Multicenter Study.

Xiaoli Liu, Max Shen, Margaret Lie, Zhongheng Zhang, Chao Liu, Deyu Li, Roger G Mark, Zhengbo Zhang, Leo Anthony Celi

Abstract read
In one paragraph

Article in Critical care explorations, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Xiaoli LiuCenter for Artificial Intelligence in Medicine, The General Hospital of PLA, Beijing, China.
Max ShenDepartment of Medicine, Beth Israel Deaconess Medical Center, Boston, MA.
Margaret LieDepartment of Medicine, Beth Israel Deaconess Medical Center, Boston, MA.
Zhongheng ZhangDepartment of Emergency Medicine, Key Laboratory of Precision Medicine in Diagnosis and Monitoring Research of Zhejiang Province, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China.
Chao LiuDepartment of Critical Care Medicine, The First Medical Center, The General Hospital of PLA, Beijing, China.
Deyu LiSchool of Biological Science and Medical Engineering, Beihang University, Beijing, China.
Roger G MarkLaboratory for Computational Physiology, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA.
Zhengbo ZhangCenter for Artificial Intelligence in Medicine, The General Hospital of PLA, Beijing, China.
Leo Anthony CeliLaboratory for Computational Physiology, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA.

Funding

Critical Care Informatics: Ethical considerations around the use and sharing of health-related dataR01EB017205 · NIBIB · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI CELI, LEO ANTHONY G, MARK, ROGER GREENWOOD · 2014 to 2021
$3.8M
NIBIB NIH HHS R01 EB017205
6 · The paper itself

Abstract

objectivesAlthough illness severity scoring systems are widely used to support clinical decision-making and assess ICU performance, their potential bias across different age, sex, and primary language groups has not been well-studied. DESIGN SETTING AND PATIENTS: We aimed to identify potential bias of Sequential Organ Failure Assessment (SOFA) and Acute Physiology and Chronic Health Evaluation (APACHE) IVa scores via large ICU databases. SETTING/PATIENTS: This multicenter, retrospective study was conducted using data from the Medical Information Mart for Intensive Care (MIMIC) and eICU Collaborative Research Database. SOFA and APACHE IVa scores were obtained from ICU admission. Hospital mortality was the primary outcome. Discrimination (area under receiver operating characteristic [AUROC] curve) and calibration (standardized mortality ratio [SMR]) were assessed for all subgroups.

interventionsNot applicable. MEASUREMENTS AND MAIN

resultsA total of 196,310 patient encounters were studied. Discrimination for both scores was worse in older patients compared with younger patients and female patients rather than male patients. In MIMIC, discrimination of SOFA in non-English primary language speakers patients was worse than that of English speakers (AUROC 0.726 vs. 0.783,

conclusionsDifferences in discrimination and calibration of two scores across varying age, sex, and primary language groups suggest illness severity scores are prone to bias in mortality predictions. Caution must be taken when using them for quality benchmarking and decision-making among diverse real-world populations.

Indexed as

bias evaluationcalibrationdiscriminationhospital mortalityillness severity scores

Identifiers

PMID38239408
PMCPMC10796141

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.