Evidence map›Paper›PMID 35353051›Full record

ArticleJMIR human factors2022

Effects of Behavioral Economics-Based Messaging on Appointment Scheduling Through Patient Portals and Appointment Completion: Observational Study.

Su-Ying Liang, Cheryl D Stults, Veena G Jones, Qiwen Huang, Jeremy Sutton, Guy Tennyson, Albert S Chan

Abstract read
In one paragraph

Article in JMIR human factors, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Review
  7. Article
  8. Review
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Su-Ying LiangSutter Health Center for Health Systems Research, Palo Alto, CA, United States.ORCID 0000-0002-6616-5970
Cheryl D StultsSutter Health Center for Health Systems Research, Palo Alto, CA, United States.ORCID 0000-0001-7958-1511
Veena G JonesClinical Leadership Team, Sutter Health, Sacramento, CA, United States.ORCID 0000-0003-0034-0446
Qiwen HuangSutter Health Center for Health Systems Research, Palo Alto, CA, United States.ORCID 0000-0003-2363-3516
Jeremy SuttonClinical Leadership Team, Sutter Health, Sacramento, CA, United States.ORCID 0000-0002-4042-4460
Guy TennysonClinical Leadership Team, Sutter Health, Sacramento, CA, United States.ORCID 0000-0003-0063-1470
Albert S ChanClinical Leadership Team, Sutter Health, Sacramento, CA, United States.ORCID 0000-0002-4972-5569

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundBehavioral economics-based techniques have been an increasingly utilized method in health care to influence behavior change by modifying language in patient communication (through choice architecture and the framing of words). Patient portals are a key tool for facilitating patient engagement in their health, and interventions deployed via patient portals have been effective in improving utilization of preventive health services.

objectiveWe examined the impacts of behavioral economics-based nudge health maintenance reminders on appointment scheduling through a patient portal and appointment completion for 2 preventive services: Medicare wellness visits and Pap smear.

methodsWe conducted a retrospective observational study using electronic health record data from an integrated health care system in Northern California. Nudge health maintenance reminders with behavioral economics-based language were implemented for all sites in November 2017 for Medicare wellness visits and for selected sites in February 2018 for Pap smears. We analyzed 125,369 health maintenance reminders for Medicare wellness visits, and 585,358 health maintenance reminders for Pap smear sent between January 2017 and February 2020. The primary outcomes were rate of appointments scheduled through the patient portal and appointment completion rate. We compared the outcomes between those who received the new, behavioral economics-based health maintenance reminders (the nudge group) and those who received the original, standard health maintenance reminders (the control group). We used segmented regression with interrupted time series to assess the immediate and gradual effect of the nudge for Medicare wellness visits, and we used logistic regression to assess the association of nudge health maintenance reminders, adjusting for the propensity to receive a nudge health maintenance reminder, for Pap smear.

resultsThe rates of appointments scheduled through the patient portal were higher for nudge health maintenance reminder recipients than those for control health maintenance reminder recipients (Medicare wellness visits-nudge: 12,537/96,839, 13.0%; control: 2,769/28,530, 9.7%, P<.001; Pap smear-nudge: 8,239/287,149, 2.9%; control: 1,868/120,047, 1.6%; P<.001). Rates of appointment completion were higher for nudge health maintenance reminders for Pap smear (nudge: 67,399/287,149, 23.5% control: 20,393/120,047, 17.0%; P<.001) but were comparable for Medicare wellness visits (nudge: 49,835/96,839, 51.5% control: 14,781/28,530, 51.8%; P=.30). There was a marginally gradual effect of nudge on number of appointments scheduled through the patient portal for the overall Medicare wellness visits sample (at a monthly rate of 0.26%, P=.09), and a significant gradual effect among scheduled appointments (at a monthly rate of 0.46%, P=.04). For Pap smear, nudge health maintenance reminders were positively associated with number of appointments scheduled through the patient portal (overall sample: propensity adjusted odds ratio [OR] 1.62; 95% CI 1.50-1.74; among scheduled appointments: propensity adjusted OR 1.61, 95% CI 1.47-1.76) and with appointment completion (propensity adjusted OR 1.07; 1.04-1.10).

conclusionsNudges, a behavioral economics-based approach to providing health maintenance reminders, increased the number of appointments scheduled through the patient portal for Medicare wellness visits and Pap smear. Our study demonstrates that a simple approach-framing and modifying language in an electronic message-can have a significant and long-term impact on patient engagement and access to care.

Indexed as

access to carebehaviorbehavioral economicshealth carehealth serviceonlineweb-based appointment scheduling

Identifiers

PMID35353051
PMCPMC9008532

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.