Evidence map›Paper›PMID 35696165›Full record

Trial reportJAMA network open2022

Effect of Text Messaging and Behavioral Interventions on COVID-19 Vaccination Uptake: A Randomized Clinical Trial.

Shivan J Mehta, Colleen Mallozzi, Pamela A Shaw, Catherine Reitz, Caitlin McDonald, Matthew Vandertuyn, Mohan Balachandran, Michael Kopinsky, Christianne Sevinc, Aaron Johnson and 5 more

Registry-linked trialOpen access · goldAbstract readRandomized Controlled Trial
In one paragraph

Trial report in JAMA network open, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04834726 (Pragmatic Trial of COVID Vaccine Text Outreach Interventions), which is not on this map. Cited by 17 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 3 pooled it
4.7field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04834726 nacompletednot on this map

Pragmatic Trial of COVID Vaccine Text Outreach Interventions

TypeinterventionalSponsorUniversity of PennsylvaniaRan2021 to 2021Enrolled19,554ConditionsCovid19ArmsOpt-In (Call-Back), Opt-in (In-Bound), Standard Message, Clinician Endorsement, Scarcity
3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 3 syntheses or guidelines pooled it, 30 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Interventions for COVID-19 Vaccine Hesitancy: A Systematic Review and Narrative Synthesis.International journal of environmental research and public health · 2023
    Pooled it
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Investigating the Role of Situational Disruptors in Engagement with Digital Mental Health Tools.CSCW : proceedings of the Conference on Computer-Supported Cooperative Work. Conference on Computer-Supported Cooperative Work · 2025
    Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors at 2 institutions in 1 country.

Shivan J MehtaDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia.
Colleen MallozziPenn Medicine, University of Pennsylvania, Philadelphia.
Pamela A ShawDepartment of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia.
Catherine ReitzDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia.
Caitlin McDonaldDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia.
Matthew VandertuynCenter for Health Care Innovation, University of Pennsylvania, Philadelphia.
Mohan BalachandranCenter for Health Care Innovation, University of Pennsylvania, Philadelphia.
Michael KopinskyCenter for Health Care Innovation, University of Pennsylvania, Philadelphia.
Christianne SevincCenter for Health Care Innovation, University of Pennsylvania, Philadelphia.
Aaron JohnsonPenn Medicine, University of Pennsylvania, Philadelphia.
Robin WardPenn Medicine, University of Pennsylvania, Philadelphia.
Sae-Hwan ParkPenn Medicine, University of Pennsylvania, Philadelphia.
Christopher K SniderCenter for Health Care Innovation, University of Pennsylvania, Philadelphia.
Roy RosinCenter for Health Care Innovation, University of Pennsylvania, Philadelphia.
David A AschDepartment of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia.
University of Pennsylvania · USUniversity of Pennsylvania Health System · US

Funding

Behavioral Economics and Population-based Colorectal Cancer ScreeningK08CA234326 · NCI · UNIVERSITY OF PENNSYLVANIA · PI MEHTA, SHIVAN JATIN · 2018 to 2022
$1.3M
NCI NIH HHS K08 CA234326
6 · The paper itself

Abstract

Importance: COVID-19 vaccine uptake among urban populations remains low. Objective: To evaluate whether text messaging with outbound or inbound scheduling and behaviorally informed content might increase COVID-19 vaccine uptake. Design, Setting, and Participants: This randomized clinical trial with a factorial design was conducted from April 29 to July 6, 2021, in an urban academic health system. The trial comprised 16 045 patients at least 18 years of age in Philadelphia, Pennsylvania, with at least 1 primary care visit in the past 5 years, or a future scheduled primary care visit within the next 3 months, who were unresponsive to prior outreach. The study was prespecified in the trial protocol, and data were obtained from the intent-to-treat population. Interventions: Eligible patients were randomly assigned in a 1:20:20 ratio to (1) outbound telephone call only by call center, (2) text message and outbound telephone call by call center to those who respond, or (3) text message, with patients instructed to make an inbound telephone call to a hotline. Patients in groups 2 and 3 were concurrently randomly assigned in a 1:1:1:1 ratio to receive different content: standard messaging, clinician endorsement (eg, "Dr. XXX recommends"), scarcity ("limited supply available"), or endowment framing ("We have reserved a COVID-19 vaccine appointment for you"). Main Outcomes and Measures: The primary outcome was the proportion of patients who completed the first dose of the COVID-19 vaccine within 1 month, according to the electronic health record. Secondary outcomes were the completion of the first dose within 2 months and completion of the vaccination series within 2 months of initial outreach. Additional outcomes included the percentage of patients with invalid cell phone numbers (wrong number or nontextable), no response to text messaging, the percentage of patients scheduled for the vaccine, text message responses, and the number of telephone calls made by the access center. Analysis was on an intention-to-treat basis. Results: Among the 16 045 patients included, the mean (SD) age was 36.9 (11.1) years; 9418 (58.7%) were women; 12 869 (80.2%) had commercial insurance, and 2283 (14.2%) were insured by Medicaid; 8345 (52.0%) were White, 4706 (29.3%) were Black, and 967 (6.0%) were Hispanic or Latino. At 1 month, 14 of 390 patients (3.6% [95% CI, 1.7%-5.4%]) in the outbound telephone call-only group completed 1 vaccine dose, as did 243 of 7890 patients (3.1% [95% CI, 2.7%-3.5%]) in the text plus outbound call group (absolute difference, -0.5% [95% CI, -2.4% to 1.4%]; P = .57) and 253 of 7765 patients (3.3% [95% CI, 2.9%-3.7%]) in the text plus inbound call group (absolute difference, -0.3% [95% CI, -2.2% to 1.6%]; P = .72). Among the 15 655 patients receiving text messaging, 118 of 3889 patients (3.0% [95% CI, 2.5%-3.6%]) in the standard messaging group completed 1 vaccine dose, as did 135 of 3920 patients (3.4% [95% CI, 2.9%-4.0%]) in the clinician endorsement group (absolute difference, 0.4% [95% CI, -0.4% to 1.2%]; P = .31), 100 of 3911 patients (2.6% [95% CI, 2.1%-3.1%]) in the scarcity group (absolute difference, -0.5% [95% CI, -1.2% to 0.3%]; P = .20), and 143 of 3935 patients (3.6% [95% CI, 3.0%-4.2%]) in the endowment group (absolute difference, 0.6% [95% CI, -0.2% to 1.4%]; P = .14). Conclusions and Relevance: There was no detectable increase in vaccination uptake among patients receiving text messaging compared with telephone calls only or behaviorally informed message content. Trial Registration: ClinicalTrials.gov Identifier: NCT04834726.

Indexed as

COVID-19Text MessagingAdultCOVID-19 VaccinesFemaleHumansMalePhiladelphiaReminder SystemsVaccinationCOVID-19 Vaccines

Identifiers

PMID35696165
PMCPMC9194662
OpenAlexW4282601903

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.