Evidence map›Paper›PMID 37340264›Full record

Trial reportJournal of general internal medicine2023

Using Nudges to Reduce Missed Appointments in Primary Care and Mental Health: a Pragmatic Trial.

Alan R Teo, Meike Niederhausen, Robert Handley, Emily E Metcalf, Aaron A Call, R Lorie Jacob, Brian J Zikmund-Fisher, Steven K Dobscha, Peter J Kaboli

Registry-linked trialOpen access · hybridAbstract readRandomized Controlled TrialPragmatic Clinical Trial
In one paragraph

Trial report in Journal of general internal medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03850431 (Using Behavioral Economics to Enhance Appointment Reminders and Reduce Missed Visits), which is not on this map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
5.7field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03850431 nacompletednot on this map

Using Behavioral Economics to Enhance Appointment Reminders and Reduce Missed Visits

TypeinterventionalSponsorVA Office of Research and DevelopmentRan2019 to 2021Enrolled34,516ConditionsAppointment RemindersArmsSocial Norms + Behavioral Instructions, Caring + Consequences for Others + Behavioral Instructions, Caring + Consequences for Self + Behavioral Instructions, Caring + Consequences for Others + Consequences for Self + Social Norms + Behavioral Instructions
3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it, 16 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 4 institutions in 1 country.

Alan R TeoVA Portland Health Care System, HSR&D Center to Improve Veteran Involvement in Care, 3710 SW US Veterans Hospital Road (R&D 66), Portland, OR, USA. alan.teo@va.gov.
Meike NiederhausenVA Portland Health Care System, HSR&D Center to Improve Veteran Involvement in Care, 3710 SW US Veterans Hospital Road (R&D 66), Portland, OR, USA.
Robert HandleyVA Portland Health Care System, HSR&D Center to Improve Veteran Involvement in Care, 3710 SW US Veterans Hospital Road (R&D 66), Portland, OR, USA.
Emily E MetcalfVA Portland Health Care System, HSR&D Center to Improve Veteran Involvement in Care, 3710 SW US Veterans Hospital Road (R&D 66), Portland, OR, USA.
Aaron A CallVA Portland Health Care System, HSR&D Center to Improve Veteran Involvement in Care, 3710 SW US Veterans Hospital Road (R&D 66), Portland, OR, USA.
R Lorie JacobVA Portland Health Care System, HSR&D Center to Improve Veteran Involvement in Care, 3710 SW US Veterans Hospital Road (R&D 66), Portland, OR, USA.
Brian J Zikmund-FisherDepartment of Health Behavior of Health Education, School of Public Health, University of Michigan, Ann Arbor, MI, USA.
Steven K DobschaVA Portland Health Care System, HSR&D Center to Improve Veteran Involvement in Care, 3710 SW US Veterans Hospital Road (R&D 66), Portland, OR, USA.
Peter J KaboliComprehensive Access and Delivery Research and Evaluation Center, Iowa City Veterans Affairs Healthcare System, Iowa City, IA, USA.
VA Portland Health Care System · USIowa City VA Health Care System · USOregon Health & Science University · USUniversity of Michigan–Ann Arbor · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundMissed appointments ("no-shows") are a persistent and costly problem in healthcare. Appointment reminders are widely used but usually do not include messages specifically designed to nudge patients to attend appointments.

objectiveTo determine the effect of incorporating nudges into appointment reminder letters on measures of appointment attendance.

designCluster randomized controlled pragmatic trial. PATIENTS: There were 27,540 patients with 49,598 primary care appointments, and 9420 patients with 38,945 mental health appointments, between October 15, 2020, and October 14, 2021, at one VA medical center and its satellite clinics that were eligible for analysis.

interventionsPrimary care (n = 231) and mental health (n = 215) providers were randomized to one of five study arms (four nudge arms and usual care as a control) using equal allocation. The nudge arms included varying combinations of brief messages developed with veteran input and based on concepts in behavioral science, including social norms, specific behavioral instructions, and consequences of missing appointments. MAIN MEASURES: Primary and secondary outcomes were missed appointments and canceled appointments, respectively. STATISTICAL ANALYSIS: Results are based on logistic regression models adjusting for demographic and clinical characteristics, and clustering for clinics and patients. KEY

resultsMissed appointment rates in study arms ranged from 10.5 to 12.1% in primary care clinics and 18.0 to 21.9% in mental health clinics. There was no effect of nudges on missed appointment rate in primary care (OR = 1.14, 95%CI = 0.96-1.36, p = 0.15) or mental health (OR = 1.20, 95%CI = 0.90-1.60, p = 0.21) clinics, when comparing the nudge arms to the control arm. When comparing individual nudge arms, no differences in missed appointment rates nor cancellation rates were observed.

conclusionsAppointment reminder letters incorporating brief behavioral nudges were ineffective in improving appointment attendance in VA primary care or mental health clinics. More complex or intensive interventions may be necessary to significantly reduce missed appointments below their current rates. TRIAL NUMBER: ClinicalTrials.gov, Trial number NCT03850431.

Indexed as

Mental HealthReminder SystemsAppointments and SchedulesHumansPatient CompliancePrimary Health Careadherencebehavioral economicsno-showtreatment engagement

Identifiers

PMID37340264
PMCPMC10356735
OpenAlexW4381434065

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.