Evidence map›Paper›PMID 42834081›Full record

ArticleNature human behaviour2026

Algorithm-assisted personalized risk communication to encourage flu vaccination in the USA: three randomized field trials.

Gail M Rosenbaum, Amir Goren, Maheen Shermohammed, Donna M Wolk, Ann Marie Tice, Joseph J Doyle, Michelle N Meyer, Christopher F Chabris

3 registry-linked trialsAbstract read
In one paragraph

Article in Nature human behaviour, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 3 registered trials, which are not on this map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04323137 nacompletednot on this map

Encouraging Flu Vaccination Among High-Risk Patients Identified by a Machine-Learning Model of Flu Complication Risk

TypeinterventionalSponsorGeisinger ClinicRan2020 to 2021Enrolled117,649ConditionsInfluenza, Vaccination, Health Promotion, Health BehaviorArmsRisk reduction, Medical records-based recommendation, Algorithm-based recommendation
NCT05009251 nacompletednot on this map

Using Explainable AI Risk Predictions to Nudge Influenza Vaccine Uptake

TypeinterventionalSponsorNational Bureau of Economic Research, Inc.Ran2021 to 2022Enrolled45,061ConditionsInfluenza, Vaccination, Health Promotion, Health BehaviorArmsReminder, Risk reduction, Medical records-based recommendation, Algorithm-based recommendation
NCT05509283 nacompletednot on this map

Nudging Flu Vaccination in Patients at Moderately High Risk for Flu and Flu-related Complications

TypeinterventionalSponsorGeisinger ClinicRan2022 to 2022Enrolled40,671ConditionsInfluenza, Vaccination, Health Promotion, Health BehaviorArmsRisk Reduction
3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Gail M RosenbaumBehavioral Insights Team, Geisinger, Danville, PA, USA.ORCID http://orcid.org/0000-0002-6306-0508
Amir GorenBehavioral Insights Team, Geisinger, Danville, PA, USA.ORCID http://orcid.org/0000-0002-4388-8869
Maheen ShermohammedBehavioral Insights Team, Geisinger, Danville, PA, USA.ORCID http://orcid.org/0000-0002-4780-7325
Donna M WolkDepartment of Laboratory Medicine, Diagnostic Medicine Institute, Geisinger, Danville, PA, USA.ORCID http://orcid.org/0000-0003-2828-5135
Ann Marie TiceDepartment of Laboratory Medicine, Diagnostic Medicine Institute, Geisinger, Danville, PA, USA.
Joseph J DoyleSloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, USA.
Michelle N Meyer *Behavioral Insights Team, Geisinger, Danville, PA, USA.ORCID http://orcid.org/0000-0001-5497-8803
Christopher F Chabris *Behavioral Insights Team, Geisinger, Danville, PA, USA. chabris@gmail.com.ORCID http://orcid.org/0000-0002-7379-7378

Funding

Pilot CoreP30AG034532 · NIA · NATIONAL BUREAU OF ECONOMIC RESEARCH · PI Marcella Alsan, JOSEPH J DOYLE · 2009 to 2026
$10.2M
NIA NIH HHS P30 AG034532U.S. Department of Health & Human Services | NIH | National Institute on Aging (U.S. National Institute on Aging) P30AG034532
6 · The paper itself

Abstract

Artificial intelligence (AI) is increasingly used in healthcare to identify high-risk patients. Laboratory studies are mixed regarding patient attitudes towards AI use. Here we field-tested whether informing patients of their risk for influenza and its complications can serve as an effective behaviour-change intervention to increase vaccination, and whether disclosing AI use in the risk determination or providing personalized reasons for the algorithm's prediction (a form of explainable AI) influence message effectiveness. We ran three preregistered randomized controlled trials with over 90,000 unique healthcare system patients in the USA (ClinicalTrials.gov identifiers: NCT04323137 , NCT05009251 and NCT05509283 ). Patients identified by a previously validated machine learning algorithm as being at high risk for influenza and related complications were randomized to be sent no message or one of several different messages encouraging influenza vaccination (the primary outcome). High-risk nudges increased vaccination: among patients informed of their high risk, vaccination was 1.1-1.4 percentage points (3.3-5.4%) higher than those simply reminded to get a vaccine, and 1.7-3.5 percentage points (3.3-14.7%) higher than non-messaged patients. Vaccination was similar across message arms that did versus did not disclose 'algorithm' involvement or its risk explanations, indicating that patients are neither averse to nor appreciative of algorithm use or explainability in this realistic health application. This work was partially funded by the National Institute on Aging of the National Institutes of Health under award number P30AG034532.

Identifiers

PMID42834081
PMCPMC13644935

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.