Evidence map›Paper›PMID 34010406›Full record

Observational studyJournal of the American Medical Informatics Association : JAMIA2021

Prediction of patient disposition: comparison of computer and human approaches and a proposed synthesis.

Yuval Barak-Corren, Isha Agarwal, Kenneth A Michelson, Todd W Lyons, Mark I Neuman, Susan C Lipsett, Amir A Kimia, Matthew A Eisenberg, Andrew J Capraro, Jason A Levy and 3 more

Registry-linked trialAbstract readObservational Study
In one paragraph

Observational study in Journal of the American Medical Informatics Association : JAMIA, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06434220 (Effect of Predictive Model on ED Physician Assessments of Patient Disposition), which is not on this map. Cited by 12 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06434220 nanot yet recruitingnot on this mapstarted 2027, after this paper: background citation

Effect of Predictive Model on ED Physician Assessments of Patient Disposition

TypeinterventionalSponsorBoston Children's HospitalRan2027 to 2027Enrolled10ConditionsPatient Outcome AssessmentArmsBaseline model, Fairness-aware model
3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Fair admission risk prediction with proportional multicalibration.Proceedings of machine learning research · 2023
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Patient safety and quality of care: a key focus for clinical informatics.Journal of the American Medical Informatics Association : JAMIA · 2021
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Yuval Barak-CorrenPredictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA.
Isha AgarwalHarvard Medical School, Boston, Massachusetts, USA.
Kenneth A MichelsonHarvard Medical School, Boston, Massachusetts, USA.
Todd W LyonsHarvard Medical School, Boston, Massachusetts, USA.
Mark I NeumanHarvard Medical School, Boston, Massachusetts, USA.
Susan C LipsettHarvard Medical School, Boston, Massachusetts, USA.
Amir A KimiaHarvard Medical School, Boston, Massachusetts, USA.
Matthew A EisenbergHarvard Medical School, Boston, Massachusetts, USA.ORCID 0000-0003-2937-2222
Andrew J CapraroHarvard Medical School, Boston, Massachusetts, USA.
Jason A LevyHarvard Medical School, Boston, Massachusetts, USA.
Joel D HudginsHarvard Medical School, Boston, Massachusetts, USA.
Ben Y ReisPredictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA.
Andrew M FineHarvard Medical School, Boston, Massachusetts, USA.

Funding

Delayed Diagnosis of Serious Pediatric Emergency ConditionsK08HS026503 · AHRQ · LURIE CHILDREN'S HOSPITAL OF CHICAGO · PI MICHELSON, KENNETH · 2019 to 2023
$763k
AHRQ HHS K08 HS026503
6 · The paper itself

Abstract

objectiveTo compare the accuracy of computer versus physician predictions of hospitalization and to explore the potential synergies of hybrid physician-computer models. MATERIALS AND

methodsA single-center prospective observational study in a tertiary pediatric hospital in Boston, Massachusetts, United States. Nine emergency department (ED) attending physicians participated in the study. Physicians predicted the likelihood of admission for patients in the ED whose hospitalization disposition had not yet been decided. In parallel, a random-forest computer model was developed to predict hospitalizations from the ED, based on data available within the first hour of the ED encounter. The model was tested on the same cohort of patients evaluated by the participating physicians.

results198 pediatric patients were considered for inclusion. Six patients were excluded due to incomplete or erroneous physician forms. Of the 192 included patients, 54 (28%) were admitted and 138 (72%) were discharged. The positive predictive value for the prediction of admission was 66% for the clinicians, 73% for the computer model, and 86% for a hybrid model combining the two. To predict admission, physicians relied more heavily on the clinical appearance of the patient, while the computer model relied more heavily on technical data-driven features, such as the rate of prior admissions or distance traveled to hospital. DISCUSSION: Computer-generated predictions of patient disposition were more accurate than clinician-generated predictions. A hybrid prediction model improved accuracy over both individual predictions, highlighting the complementary and synergistic effects of both approaches.

conclusionThe integration of computer and clinician predictions can yield improved predictive performance.

Indexed as

Emergency Service, HospitalHospitalizationChildComputersHumansPatient DischargePredictive Value of TestsUnited Statesemergency medicinemachine learningprediction, decision support, human-computer interaction

Identifiers

PMID34010406
PMCPMC8324238

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.