Trial reportJAMA internal medicine2020
Effect of Patient Portal Reminders Sent by a Health Care System on Influenza Vaccination Rates: A Randomized Clinical Trial.
Trial report in JAMA internal medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03666026 (Improving Influenza Vaccination Delivery Across a Health System by the Electronic Health Records Patient Portal), which is not on this map. Cited by 41 papers, 4 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Improving Influenza Vaccination Delivery Across a Health System by the Electronic Health Records Patient Portal
Who cites it
41 citing papers in PubMed, 4 syntheses or guidelines pooled it, 66 citations in OpenAlex.
- The Effectiveness of Digital Interventions to Increase Preventive Care Uptake in Older Adults: Systematic Review.JMIR aging · 2026Pooled it
- Impact of educational interventions on the prevention of influenza: A systematic review.Frontiers in public health · 2022Pooled it
- A meta-analysis of influenza vaccination following correspondence: Considerations for COVID-19.Vaccine · 2021Pooled it
- Nudging toward vaccination: a systematic review.BMJ global health · 2021Pooled it
- Impact of Financial Incentives on Electronic Health Record-Driven Recruitment of Underrepresented Communities in Research: Randomized Controlled Trial.Journal of medical Internet research · 2026Trial
- Nudges to Clinicians and Patients for Influenza Vaccines During Visits: The BE IMMUNE Randomized Clinical Trial.JAMA internal medicine · 2026Trial
- Video and Infographic Messages From Primary Care Physicians and Influenza Vaccination Rates: A Randomized Clinical Trial.JAMA network open · 2025Trial
- A behaviourally informed chatbot increases vaccination rates in Argentina more than a one-way reminder.Nature human behaviour · 2024Trial
- Electronic nudges for sustained influenza vaccination uptake in older adults: the nationwide randomized NUDGE-FLU-2 trial.Nature medicine · 2024Trial
- [Application and Effect of Patient Portal System in the Remote Management of Chronic Diseases for Older Adults With Coronary Heart Disease].Sichuan da xue xue bao. Yi xue ban = Journal of Sichuan University. Medical science edition · 2024Trial
- Informational Postcards Increase Engagement with Remote Monitoring Among Veterans with Pacemakers and Implantable Cardioverter-Defibrillators: a Stepped-Wedge Randomized Controlled Trial.Journal of general internal medicine · 2024Trial
- Evaluation of behavioral economic strategies to raise influenza vaccination rates across a health system: Results from a randomized clinical trial.Preventive medicine · 2023Trial
- Effect of Electronic Outreach Using Patient Portal Messages on Well Child Care Visit Completion: A Randomized Clinical Trial.JAMA network open · 2022Trial
- Influence of Digital Intervention Messaging on Influenza Vaccination Rates Among Adults With Cardiovascular Disease in the United States: Decentralized Randomized Controlled Trial.Journal of medical Internet research · 2022Trial
- Targeted Electronic Patient Portal Messaging Increases Hepatitis C Virus Screening in Primary Care: a Randomized Study.Journal of general internal medicine · 2022Trial
- Effect of Electronic and Mail Outreach From Primary Care Physicians for COVID-19 Vaccination of Black and Latino Older Adults: A Randomized Clinical Trial.JAMA network open · 2022Trial
- Impact of Patient Portal Messaging Reminders with Self-Scheduling Option on Influenza Vaccination Rates: a Prospective, Randomized Trial.Journal of general internal medicine · 2022Trial
- Effect of Personalized Messages Sent by a Health System's Patient Portal on Influenza Vaccination Rates: a Randomized Clinical Trial.Journal of general internal medicine · 2022Trial
- Patient Portal Reminders for Pediatric Influenza Vaccinations: A Randomized Clinical Trial.Pediatrics · 2021Trial
- Electronic Health Record Portal Messages and Interactive Voice Response Calls to Improve Rates of Early Season Influenza Vaccination: Randomized Controlled Trial.Journal of medical Internet research · 2020Trial
Corrections and comments
- Commented on by
Authors and funding
13 authors at 6 institutions in 2 countries.
Funding
Abstract
Importance: Influenza vaccination rates across the US are low. Because few practices send patient reminders for influenza vaccination, a scalable patient reminder system is needed. Objective: To evaluate the effect of patient reminders sent via a health care system's electronic health record patient portal on influenza vaccination rates. Design, Setting, and Participants: This pragmatic, 4-arm randomized clinical trial was performed from October 1, 2018, to March 31, 2019, across the UCLA (University of California, Los Angeles) health care system. A total of 164 205 patients in 52 primary care practices who had used the patient portal within 12 months were included. Interventions: Patients due for an influenza vaccine were sent a letter via the patient portal of the health care system reminding them about the importance of influenza vaccination, safety of the vaccine, and morbidity associated with influenza. Patients were randomized within primary care practices to 1 of 4 study groups (no reminder [n = 41 070] vs 1 reminder [n = 41 055], 2 reminders [n = 41 046], or 3 reminders [n = 41 034]). Main Outcomes and Measures: The primary outcome was receipt of 1 or more influenza vaccines as documented in the electronic health record, which was supplemented with influenza vaccination data from external sources (eg, pharmacies). Secondary outcomes were influenza vaccination rates among subgroups and influenza vaccinations self-reported by patients in reply to the portal-based query as having been received elsewhere. Results: A total of 164 205 patients (mean [SD] age, 46.2 [19.6] years; 95 779 [58.3%] female) were randomly allocated to 1 of the 4 study arms. In the primary analysis across all ages and not including patient self-reported vaccinations in reply to portal reminders, influenza vaccination rates were 37.5% for those receiving no reminders, 38.0% for those receiving 1 reminder (P = .008 vs no reminder), 38.2% for those receiving 2 reminders (P = .03 vs no reminder), and 38.2% for those receiving 3 reminders (P = .02 vs no reminder). In the secondary analysis not including patient self-reported vaccinations, among adults aged 18 to 64 years (vaccination rates: 32.0% in the control group, 32.8% in the 1-reminder group, 32.8% in the 2-reminder group, and 32.8% in the 3-reminder group; P = .001), male patients (vaccination rates: 37.3% vs 38.3%, 38.6%, and 38.8%; P = .001), non-Hispanic patients (vaccination rates: 37.6% vs 38.2%, 38.3%, and 38.2%; P = .004), and those who were not vaccinated in the prior 2 years (vaccination rates: 15.3% vs 15.9%, 16.3%, and 16.1%; P < .001), vaccination rates were higher in the portal reminder groups than in the control group; the findings in these 3 subgroups mirrored the findings in the entire population. When self-reported vaccinations received elsewhere were included, influenza vaccination rates were 1.4 to 2.9 percentage points higher in the portal reminder groups, with a dose-response effect (0 reminders: 15 537 [37.8%]; 1 reminder: 16 097 [39.2%]; 2 reminders: 16 426 [40.0%]; and 3 reminders: 16 714 [40.7%]; P < .001). Conclusions and Relevance: Generic patient portal reminders were effective in minimally increasing influenza vaccination rates, but more intensive or more targeted patient motivational strategies appear to be needed. Trial Registration: ClinicalTrials.gov Identifier: NCT03666026.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.