Evidence map›Paper›PMID 34912043›Full record

ArticleNPJ digital medicine2021

Prediction across healthcare settings: a case study in predicting emergency department disposition.

Yuval Barak-Corren, Pradip Chaudhari, Jessica Perniciaro, Mark Waltzman, Andrew M Fine, Ben Y Reis

Registry-linked trialAbstract read
In one paragraph

Article in NPJ digital medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06434220 (Effect of Predictive Model on ED Physician Assessments of Patient Disposition), which is not on this map. Cited by 18 papers.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06434220 nanot yet recruitingnot on this mapstarted 2027, after this paper: background citation

Effect of Predictive Model on ED Physician Assessments of Patient Disposition

TypeinterventionalSponsorBoston Children's HospitalRan2027 to 2027Enrolled10ConditionsPatient Outcome AssessmentArmsBaseline model, Fairness-aware model
3 · Its place in the literature

Who cites it

18 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Fair admission risk prediction with proportional multicalibration.Proceedings of machine learning research · 2023
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Yuval Barak-CorrenPredictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA. yuval.barakcorren@childrens.harvard.edu.ORCID http://orcid.org/0000-0002-9603-4728
Pradip ChaudhariDivision of Emergency and Transport Medicine, Children's Hospital Los Angeles and Keck School of Medicine of the University of Southern California, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0002-7732-632X
Jessica PerniciaroDivision of Emergency and Transport Medicine, Children's Hospital Los Angeles and Keck School of Medicine of the University of Southern California, Los Angeles, CA, USA.
Mark WaltzmanHarvard Medical School, Boston, MA, USA.
Andrew M Fine *Harvard Medical School, Boston, MA, USA.
Ben Y Reis *Predictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Several approaches exist today for developing predictive models across multiple clinical sites, yet there is a lack of comparative data on their performance, especially within the context of EHR-based prediction models. We set out to provide a framework for prediction across healthcare settings. As a case study, we examined an ED disposition prediction model across three geographically and demographically diverse sites. We conducted a 1-year retrospective study, including all visits in which the outcome was either discharge-to-home or hospitalization. Four modeling approaches were compared: a ready-made model trained at one site and validated at other sites, a centralized uniform model incorporating data from all sites, multiple site-specific models, and a hybrid approach of a ready-made model re-calibrated using site-specific data. Predictions were performed using XGBoost. The study included 288,962 visits with an overall admission rate of 16.8% (7.9-26.9%). Some risk factors for admission were prominent across all sites (e.g., high-acuity triage emergency severity index score, high prior admissions rate), while others were prominent at only some sites (multiple lab tests ordered at the pediatric sites, early use of ECG at the adult site). The XGBoost model achieved its best performance using the uniform and site-specific approaches (AUC = 0.9-0.93), followed by the calibrated-model approach (AUC = 0.87-0.92), and the ready-made approach (AUC = 0.62-0.85). Our results show that site-specific customization is a key driver of predictive model performance.

Identifiers

PMID34912043
PMCPMC8674364

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.