Evidence map›Paper›PMID 31825503›Full record

Observational studyJAMA network open2019

Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care.

Kyan C Safavi, Taghi Khaniyev, Martin Copenhaver, Mark Seelen, Ana Cecilia Zenteno Langle, Jonathan Zanger, Bethany Daily, Retsef Levi, Peter Dunn

Abstract readObservational StudyValidation Study
In one paragraph

Observational study in JAMA network open, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 46 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
46citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

46 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Guideline
  4. Pooled it
  5. Trial
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

9 authors.

Kyan C SafaviDepartment of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston.
Taghi KhaniyevMIT Sloan School of Management, Massachusetts Institute of Technology, Cambridge.
Martin CopenhaverDepartment of Perioperative Services, Massachusetts General Hospital, Boston.
Mark SeelenDepartment of Perioperative Services, Massachusetts General Hospital, Boston.
Ana Cecilia Zenteno LangleDepartment of Perioperative Services, Massachusetts General Hospital, Boston.
Jonathan ZangerMIT Sloan School of Management, Massachusetts Institute of Technology, Cambridge.
Bethany DailyDepartment of Perioperative Services, Massachusetts General Hospital, Boston.
Retsef LeviMIT Sloan School of Management, Massachusetts Institute of Technology, Cambridge.
Peter DunnDepartment of Perioperative Services, Massachusetts General Hospital, Boston.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Importance: Inpatient overcrowding is associated with delays in care, including the deferral of surgical care until beds are available to accommodate postoperative patients. Timely patient discharge is critical to address inpatient overcrowding and requires coordination among surgeons, nurses, case managers, and others. This is difficult to achieve without early identification and systemwide transparency of discharge candidates and their respective barriers to discharge. Objective: To validate the performance of a clinically interpretable feedforward neural network model that could improve the discharge process by predicting which patients would be discharged within 24 hours and their clinical and nonclinical barriers. Design, Setting, and Participants: This prognostic study included adult patients discharged from inpatient surgical care from May 1, 2016, to August 31, 2017, at a quaternary care teaching hospital. Model performance was assessed with standard cross-validation techniques. The model's performance was compared with a baseline model using historical procedure median length of stay to predict discharges. In prospective cohort analysis, the feedforward neural network model was used to make predictions on general surgical care floors with 63 beds. If patients were not discharged when predicted, the causes of delay were recorded. Main Outcomes and Measures: The primary outcome was the out-of-sample area under the receiver operating characteristic curve of the model. Secondary outcomes included the causes of discharge delay and the number of avoidable bed-days. Results: The model was trained on 15 201 patients (median [interquartile range] age, 60 [46-70] years; 7623 [50.1%] men) discharged from inpatient surgical care. The estimated out-of-sample area under the receiver operating characteristic curve of the model was 0.840 (SD, 0.008; 95% CI, 0.839-0.844). Compared with the baseline model, the neural network model had higher sensitivity (52.5% vs 56.6%) and specificity (51.7% vs 82.6%). The neural network model identified 65 barriers to discharge. In the prospective study of 605 patients, causes of delays included clinical barriers (41 patients [30.1%]), variation in clinical practice (30 patients [22.1%]), and nonclinical reasons (65 patients [47.8%]). Summing patients who were not discharged owing to variation in clinical practice and nonclinical reasons, 128 bed-days, or 1.2 beds per day, were classified as avoidable. Conclusions and Relevance: This cohort study found that a neural network model could predict daily inpatient surgical care discharges and their barriers. The model identified systemic causes of discharge delays. Such models should be studied for their ability to increase the timeliness of discharges.

Indexed as

Machine LearningModels, TheoreticalNeural Networks, ComputerPatient DischargeAdolescentAdultAgedAged, 80 and overFemaleHumansMaleMiddle AgedPostoperative CarePrognosisProspective StudiesSensitivity and Specificity

Identifiers

PMID31825503
PMCPMC6991195

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.