Evidence map›Paper›PMID 39331682›Full record

ArticlePLOS digital health2024

Aspiring to clinical significance: Insights from developing and evaluating a machine learning model to predict emergency department return visit admissions.

Yiye Zhang, Yufang Huang, Anthony Rosen, Lynn G Jiang, Matthew McCarty, Arindam RoyChoudhury, Jin Ho Han, Adam Wright, Jessica S Ancker, Peter Ad Steel

Abstract read
In one paragraph

Article in PLOS digital health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Observational
  7. Review
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Yiye ZhangDepartment of Population Health Sciences, Weill Cornell Medicine, New York, New York, United States of America.ORCID https://orcid.org/0000-0003-3494-2699
Yufang HuangDepartment of Population Health Sciences, Weill Cornell Medicine, New York, New York, United States of America.
Anthony RosenDepartment of Emergency Medicine, Weill Cornell Medicine, New York, New York, United States of America.
Lynn G JiangDepartment of Emergency Medicine, Weill Cornell Medicine, New York, New York, United States of America.
Matthew McCartyDepartment of Emergency Medicine, Weill Cornell Medicine, New York, New York, United States of America.
Arindam RoyChoudhuryDepartment of Population Health Sciences, Weill Cornell Medicine, New York, New York, United States of America.
Jin Ho HanDepartment of Emergency Medicine, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America.
Adam WrightDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America.
Jessica S AnckerDepartment of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America.
Peter Ad SteelDepartment of Emergency Medicine, Weill Cornell Medicine, New York, New York, United States of America.

Funding

Clinical and Translational Science AwardUL1TR001873 · NCATS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI REILLY, MUREDACH P · 2016 to 2025
$99.0M
Disparities in COVID Disease Severity and Outcomes in New York CityUL1TR002384 · NCATS · WEILL MEDICAL COLL OF CORNELL UNIV · PI JULIANNE L IMPERATO-MCGINLEY · 2017 to 2026
$86.2M
GEMRA: Geriatric Emergency Medicine Risk Prediction Model for Return VisitAdmissionsR01AG076998 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI Rahul Sharma, Yiye Zhang · 2023 to 2026
$3.0M
NCATS NIH HHS UL1 TR001873NCATS NIH HHS UL1 TR002384NIA NIH HHS R01 AG076998
6 · The paper itself

Abstract

Return visit admissions (RVA), which are instances where patients discharged from the emergency department (ED) rapidly return and require hospital admission, have been associated with quality issues and adverse outcomes. We developed and validated a machine learning model to predict 72-hour RVA using electronic health records (EHR) data. Study data were extracted from EHR data in 2019 from three urban EDs. The development and independent validation datasets included 62,154 patients from two EDs and 73,453 patients from one ED, respectively. Multiple machine learning algorithms were evaluated, including deep significance clustering (DICE), regularized logistic regression (LR), Gradient Boosting Decision Tree, and XGBoost. These machine learning models were also compared against an existing clinical risk score. To support clinical actionability, clinician investigators conducted manual chart reviews of the cases identified by the model. Chart reviews categorized predicted cases across index ED discharge diagnosis and RVA root cause classifications. The best-performing model achieved an AUC of 0.87 in the development site (test set) and 0.75 in the independent validation set. The model, which combined DICE and LR, boosted predictive performance while providing well-defined features. The model was relatively robust to sensitivity analyses regarding performance across age, race, and by varying predictor availability but less robust across diagnostic groups. Clinician examination demonstrated discrete model performance characteristics within clinical subtypes of RVA. This machine learning model demonstrated a strong predictive performance for 72- RVA. Despite the limited clinical actionability potentially due to model complexity, the rarity of the outcome, and variable relevance, the clinical examination offered guidance on further variable inclusion for enhanced predictive accuracy and actionability.

Identifiers

PMID39331682
PMCPMC11432862

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.