Evidence map›Paper›PMID 36195982›Full record

Trial reportAmerican journal of health promotion : AJHP2023

A Randomized Trial of Behavioral Nudges Delivered Through Text Messages to Increase Influenza Vaccination Among Patients With an Upcoming Primary Care Visit.

Mitesh S Patel, Katherine L Milkman, Linnea Gandhi, Heather N Graci, Dena Gromet, Hung Ho, Joseph S Kay, Timothy W Lee, Jake Rothschild, Modupe Akinola and 36 more

2 registry-linked trialsAbstract readRandomized Controlled Trial
PubMed Full text at PMC Publisher
In one paragraph

Trial report in American journal of health promotion : AJHP, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 19 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06566534 nacompletednot on this mapstarted 2024, after this paper: background citation

A Prospective Randomized Trial of Personalized Nudges to Increase Influenza Vaccinations

TypeinterventionalSponsorGeisinger ClinicRan2024 to 2024Enrolled77,482ConditionsInfluenza, HumanArmsReminder
NCT07161739 naactive not recruitingnot on this mapstarted 2025, after this paper: background citation

Vaccination Nudges Project: Behavioural Nudges From Pharmacists to Increase Influenza and Travel Vaccination Uptake: A Pragmatic Randomized Control Trial.

TypeinterventionalSponsorUniversity of CalgaryRan2025 to 2026Enrolled20,000ConditionsStroke, Influenza Human, Influenza Vaccines, Health Behavior ChangeArmsBehavioural Nudge (Influenza Risk Reduction), Behavioural Nudge (Travel Vaccination Benefit)
3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Article
  7. Article
  8. Review
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Review
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

46 authors.

Mitesh S Patel2974Department of Clinical Transformation and Behavioral Insights, Ascension, St. Louis, MO, USA.ORCID 0000-0002-5997-9984
Katherine L Milkman6569Department of Operations, Information and Decisions, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Linnea Gandhi6569Department of Operations, Information and Decisions, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Heather N Graci6569Behavior Change for Good Initiative, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.ORCID 0000-0002-9220-729X
Dena Gromet6569Behavior Change for Good Initiative, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Hung Ho3270Department of Marketing, The University of Chicago Booth School of Business, Chicago, IL, USA.
Joseph S Kay6569Behavior Change for Good Initiative, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.ORCID 0000-0002-1436-1304
Timothy W Lee5798School of Professional Studies, Northwestern University, Evanston, IL, USA.
Jake Rothschild6569Behavior Change for Good Initiative, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.
Modupe Akinola1812Department of Management, Columbia Business School, Columbia University, New York, NY, USA.
John BeshearsNegotiation, Organizations & Markets Unit, Harvard Business School, Harvard University, Boston, MA, USA.
Jonathan E BogardDepartment of Behavioral Decision Making, Anderson School of Management, University of California, Los Angeles, CA, USA.
Alison Buttenheim6612Department of Family and Community Health, The University of Pennsylvania School of Nursing, Philadelphia, PA, USA.
Christopher Chabris2780Behavioral and Decision Sciences Program, Geisinger Health System, Danville, PA, USA.
Gretchen B Chapman7938Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA.
James J Choi6756Department of Finance, Yale School of Management, Yale University, New Haven, CT, USA.
Hengchen Dai8783Department of Management and Organization, Anderson School of Management, University of California Los Angeles, Los Angeles, CA, USA.
Craig R Fox8783Department of Management and Organization, Anderson School of Management, University of California Los Angeles, Los Angeles, CA, USA.
Amir Goren2780Behavioral Insights Team, Geisinger Health System, Danville, PA, USA.
Matthew D HilcheyDepartment of Behavioural Science and Economics, University of Toronto, Toronto, ON, Canada.ORCID 0000-0003-1998-847X
Jillian HmurovicDepartment of Marketing, Drexel University, Philadelphia, PA, USA.
Leslie K JohnNegotiation, Organizations & Markets Unit, Harvard Business School, Harvard University, Boston, MA, USA.
Dean KarlanDepartment of Finance, Kellogg School of Management, Northwestern University, Evanston, IL, USA.ORCID 0000-0003-0164-1398
Melanie KimDepartment of Behavioural Science and Economics, University of Toronto, Toronto, ON, Canada.
David LaibsonNegotiation, Organizations & Markets Unit, Harvard Business School, Harvard University, Boston, MA, USA.
Cait LambertonDepartment of Marketing, The Wharton School, 6569University of Pennsylvania, Philadelphia, PA, USA.
Brigitte C MadrianDepartment of Finance, Marriott School of Business, 33865Brigham Young University, Provo, UT, USA.
Michelle N Meyer2780Behavioral and Decision Sciences Program, Geisinger Health System, Danville, PA, USA.
Maria Modanu1812Department of Management, Columbia Business School, Columbia University, New York, NY, USA.
Jimin NamNegotiation, Organizations & Markets Unit, Harvard Business School, Harvard University, Boston, MA, USA.
Todd RogersNegotiation, Organizations & Markets Unit, Harvard Business School, Harvard University, Boston, MA, USA.
Renante RondinaDepartment of Behavioural Science and Economics, University of Toronto, Toronto, ON, Canada.
Silvia Saccardo7938Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA.
Maheen Shermohammed2780Behavioral and Decision Sciences Program, Geisinger Health System, Danville, PA, USA.
Dilip SomanDepartment of Behavioural Science and Economics, University of Toronto, Toronto, ON, Canada.
Jehan SparksDepartment of Behavioral Decision Making, Anderson School of Management, University of California, Los Angeles, CA, USA.
Caleb WarrenDepartment of Marketing, Eller College of Management, University of Arizona, Tucson, AZ, USA.ORCID 0000-0002-4211-3455
Megan WeberDepartment of Behavioral Decision Making, Anderson School of Management, University of California, Los Angeles, CA, USA.
Ron BermanDepartment of Marketing, The Wharton School, 6569University of Pennsylvania, Philadelphia, PA, USA.ORCID 0000-0002-8594-3627
Chalanda N EvansCenter for Digital Health, Perelman School of Medicine, 6569University of Pennsylvania, Philadelphia, PA, USA.
Seung Hyeong LeeNegotiation, Organizations & Markets Unit, Harvard Business School, Harvard University, Boston, MA, USA.
Christopher K SniderCenter for Health Care Innovation, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Eli TsukayamaBusiness Administration Division, University of Hawai`i-West O`ahu, Kapolei, HI, USA.
Christophe Van den BulteDepartment of Marketing, The Wharton School, 6569University of Pennsylvania, Philadelphia, PA, USA.
Kevin G VolppPenn Center for Health Incentives and Behavioral Economics, Departments of Medical Ethics and Health Policy and Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Angela L Duckworth6569Department of Operations, Information and Decisions, The Wharton School, University of Pennsylvania, Philadelphia, PA, USA.

Funding

USC-Yale Roybal Center for Behavioral Interventions in AgingP30AG024968 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI JASON N. DOCTOR · 2004 to 2026
$14.7M
Pilot CoreP30AG034532 · NIA · NATIONAL BUREAU OF ECONOMIC RESEARCH · PI JOSEPH J DOYLE · 2009 to 2026
$10.2M
NIA NIH HHS P30 AG034532
6 · The paper itself

Abstract

purposeTo evaluate if nudges delivered by text message prior to an upcoming primary care visit can increase influenza vaccination rates.

designRandomized, controlled trial.

settingTwo health systems in the Northeastern US between September 2020 and March 2021. SUBJECTS: 74,811 adults.

interventionsPatients in the 19 intervention arms received 1-2 text messages in the 3 days preceding their appointment that varied in their format, interactivity, and content. MEASURES: Influenza vaccination. ANALYSIS: Intention-to-treat.

resultsParticipants had a mean (SD) age of 50.7 (16.2) years; 55.8% (41,771) were female, 70.6% (52,826) were White, and 19.0% (14,222) were Black. Among the interventions, 5 of 19 (26.3%) had a significantly greater vaccination rate than control. On average, the 19 interventions increased vaccination relative to control by 1.8 percentage points or 6.1% (

conclusionsText messages encouraging vaccination and delivered prior to an upcoming appointment significantly increased influenza vaccination rates and could be a scalable approach to increase vaccination more broadly.

Indexed as

Influenza, HumanInfluenza VaccinesText MessagingAdultFemaleHumansMaleMiddle AgedPrimary Health CareReminder SystemsVaccinationInfluenza Vaccinesbehavioral nudgeCOVID-19influenzatext messagevaccination

Identifiers

PMID36195982
PMCPMC10798571

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.