Evidence map›Paper›PMID 36757667›Full record

ArticleJournal of general internal medicine2023

Application of a Machine Learning Algorithm to Develop and Validate a Prediction Model for Ambulatory Non-Arrivals.

Kevin Coppa, Eun Ji Kim, Michael I Oppenheim, Kevin R Bock, Theodoros P Zanos, Jamie S Hirsch

Abstract read
In one paragraph

Article in Journal of general internal medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Kevin CoppaClinical Digital Solutions, Northwell Health, New Hyde Park, NY, USA.
Eun Ji KimDonald and Barbara Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA.
Michael I OppenheimClinical Digital Solutions, Northwell Health, New Hyde Park, NY, USA.
Kevin R BockClinical Digital Solutions, Northwell Health, New Hyde Park, NY, USA.
Theodoros P ZanosDonald and Barbara Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA.
Jamie S HirschClinical Digital Solutions, Northwell Health, New Hyde Park, NY, USA. jhirsch8@northwell.edu.ORCID http://orcid.org/0000-0001-9571-1275

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundNon-arrivals to scheduled ambulatory visits are common and lead to a discontinuity of care, poor health outcomes, and increased subsequent healthcare utilization. Reducing non-arrivals is important given their association with poorer health outcomes and cost to health systems.

objectiveTo develop and validate a prediction model for ambulatory non-arrivals.

designRetrospective cohort study. PATIENTS OR SUBJECTS: Patients at an integrated health system who had an outpatient visit scheduled from January 1, 2020, to February 28, 2022. MAIN MEASURES: Non-arrivals to scheduled appointments. KEY

resultsThere were over 4.3 million ambulatory appointments from 1.2 million adult patients. Patients with appointment non-arrivals were more likely to be single, racial/ethnic minorities, and not having an established primary care provider compared to those who arrived at their appointments. A prediction model using the XGBoost machine learning algorithm had the highest AUC value (0.768 [0.767-0.770]). Using SHAP values, the most impactful features in the model include rescheduled appointments, lead time (number of days from scheduled to appointment date), appointment provider, number of days since last appointment with the same department, and a patient's prior appointment status within the same department. Scheduling visits close to an appointment date is predicted to be less likely to result in a non-arrival. Overall, the prediction model calibrated well for each department, especially over the operationally relevant probability range of 0 to 40%. Departments with fewer observations and lower non-arrival rates generally had a worse calibration.

conclusionsUsing a machine learning algorithm, we developed a prediction model for non-arrivals to scheduled ambulatory appointments usable for all medical specialties. The proposed prediction model can be deployed within an electronic health system or integrated into other dashboards to reduce non-arrivals. Future work will focus on the implementation and application of the model to reduce non-arrivals.

Indexed as

AlgorithmsAppointments and SchedulesAdultHumansMachine LearningRetrospective StudiesTime Factors

Identifiers

PMID36757667
PMCPMC9910253

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.