Evidence map›Paper›PMID 36870572›Full record

Trial reportPreventive medicine2023

Evaluation of behavioral economic strategies to raise influenza vaccination rates across a health system: Results from a randomized clinical trial.

Peter G Szilagyi, Alejandra Casillas, O Kenrik Duru, Michael K Ong, Sitaram Vangala, Chi-Hong Tseng, Christina Albertin, Sharon G Humiston, Mindy K Ross, Sarah R Friedman and 5 more

Registry-linked trialAbstract readRandomized Controlled Trial
PubMed Full text at PMC Publisher
In one paragraph

Trial report in Preventive medicine, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06657573 (AI-enabled Vaccine Chatbot for Improving Influenza Vaccination Uptake in Children), which is not on this map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06657573 nanot yet recruitingnot on this mapstarted 2024, after this paper: background citation

AI-enabled Vaccine Chatbot for Improving Influenza Vaccination Uptake in Children: a Cluster Randomized Trial

TypeinterventionalSponsorFudan UniversityRan2024 to 2025Enrolled1,200ConditionsInfluenza VaccinesArmsAn AI-enabled chatbot tailored for influenza vaccine consultation
3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Article
  8. Review
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Peter G SzilagyiDepartment of Pediatrics, UCLA Mattel Children's Hospital, University of California at Los Angeles, Los Angeles, CA, United States of America. Electronic address: PSzilagyi@mednet.ucla.edu.
Alejandra CasillasDepartment of Medicine, David Geffen School of Medicine, University of California at Los Angeles, CA, United States of America. Electronic address: Acasillas@mednet.ucla.edu.
O Kenrik DuruDepartment of Medicine, David Geffen School of Medicine, University of California at Los Angeles, CA, United States of America. Electronic address: KfcDuru@mednet.ucla.edu.
Michael K OngDepartment of Medicine, David Geffen School of Medicine, University of California at Los Angeles, CA, United States of America; VA Greater Los Angeles Healthcare System, Los Angeles, CA, United States of America; Department of Health Policy and Management, Fielding School of Public Health, University of California, Los Angeles, CA, United States of America. Electronic address: MOng@mednet.ucla.edu.
Sitaram VangalaDepartment of Medicine Statistics Core, David Geffen School of Medicine, University of California at Los Angeles, CA, United States of America. Electronic address: Svangala@mednet.ucla.edu.
Chi-Hong TsengDepartment of Medicine Statistics Core, David Geffen School of Medicine, University of California at Los Angeles, CA, United States of America. Electronic address: CTseng@mednet.ucla.edu.
Christina AlbertinDepartment of Pediatrics, UCLA Mattel Children's Hospital, University of California at Los Angeles, Los Angeles, CA, United States of America. Electronic address: calbertin@mednet.ucla.edu.
Sharon G HumistonImmunize.org, St. Paul, MN, United States of America. Electronic address: Sharon@immunize.org.
Mindy K RossDepartment of Pediatrics, UCLA Mattel Children's Hospital, University of California at Los Angeles, Los Angeles, CA, United States of America. Electronic address: Mross@mednet.ucla.edu.
Sarah R FriedmanDepartment of Pediatrics, UCLA Mattel Children's Hospital, University of California at Los Angeles, Los Angeles, CA, United States of America.
Sharon EvansDepartment of Information Services and Solutions, UCLA Health System, Los Angeles, CA, United States of America. Electronic address: Saevans@mednet.ucla.edu.
Michael SloyanDepartment of Information Services and Solutions, UCLA Health System, Los Angeles, CA, United States of America. Electronic address: Msloyan@mednet.ucla.edu.
Jonathan E BogardOlin Business School Washington University in Saint Louis, United States of America. Electronic address: bogard@wustl.edu.
Craig R FoxDepartment of Medicine, David Geffen School of Medicine, University of California at Los Angeles, CA, United States of America; Anderson School of Management, University of California at Los Angeles, CA, United States of America; Department of Psychology, University of California at Los Angeles, CA, United States of America. Electronic address: Craig.fox@anderson.ucla.edu.
Carlos LernerDepartment of Pediatrics, UCLA Mattel Children's Hospital, University of California at Los Angeles, Los Angeles, CA, United States of America. Electronic address: CLerner@mednet.ucla.edu.

Funding

UCLA Clinical Translational Science InstituteUL1TR001881 · NCATS · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI ARLEEN F. BROWN, ARASH NAEIM · 2016 to 2026
$118.1M
Improving Influenza Vaccination Delivery Across a Health System by the Electronic Health Records Patient PortalR01AI135029 · NIAID · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI SZILAGYI, PETER G · 2018 to 2022
$3.7M
NCATS NIH HHS UL1 TR001881NIAID NIH HHS R01 AI135029
6 · The paper itself

Abstract

Influenza vaccination rates are low. Working with a large US health system, we evaluated three health system-wide interventions using the electronic health record's patient portal to improve influenza vaccination rates. We performed a two-arm RCT with a nested factorial design within the treatment arm, randomizing patients to usual-care control (no portal interventions) or to one or more portal interventions. We included all patients within this health system during the 2020-2021 influenza vaccination season, which overlapped with the COVID-19 pandemic. Through the patient portal, we simultaneously tested: pre-commitment messages (sent September 2020, asking patients to commit to a vaccination); monthly portal reminders (October - December 2020), direct appointment scheduling (patients could self-schedule influenza vaccination at multiple sites); and pre-appointment reminder messages (sent before scheduled primary care appointments, reminding patients about influenza vaccination). The main outcome measure was receipt of influenza vaccine (10/01/2020-03/31/2021). We randomized 213,773 patients (196,070 adults ≥18 years, 17,703 children). Influenza vaccination rates overall were low (39.0%). Vaccination rates for study arms did not differ: Control (38.9%), pre-commitment vs no pre-commitment (39.2%/38.9%), direct appointment scheduling yes/no (39.1%/39.1%), pre-appointment reminders yes/no (39.1%/39.1%); p > 0.017 for all comparisons (p value cut-off adjusted for multiple comparisons). After adjusting for age, gender, insurance, race, ethnicity, and prior influenza vaccination, none of the interventions increased vaccination rates. We conclude that patient portal interventions to remind patients to receive influenza vaccine during the COVID-19 pandemic did not raise influenza immunization rates. More intensive or tailored interventions are needed beyond portal innovations to increase influenza vaccination.

Indexed as

COVID-19Influenza, HumanInfluenza VaccinesAdultChildEconomics, BehavioralHumansPandemicsReminder SystemsVaccinationInfluenza VaccinesBehavioral economicsInfluenza vaccinationPatient portalRandomized clinical trial

Identifiers

PMID36870572
PMCPMC11064058

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.