Evidence map›Paper›PMID 24793941›Full record

Trial reportVaccine2014

Cluster randomized trial of a toolkit and early vaccine delivery to improve childhood influenza vaccination rates in primary care.

Richard K Zimmerman, Mary Patricia Nowalk, Chyongchiou Jeng Lin, Kristin Hannibal, Krissy K Moehling, Hsin-Hui Huang, Annamore Matambanadzo, Judith Troy, Norma J Allred, Greg Gallik and 1 more

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Vaccine, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT01664793 (From Innovation to Solutions), which is not on this map. Cited by 19 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 5 pooled it
2.1field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT01664793 nacompletednot on this map

From Innovation to Solutions: Autodialers, Use of Early Autumn Physicals and Vaccination Assessment as a Vital Sign to Increase Childhood Influenza Vaccination in Diverse Settings

TypeinterventionalSponsorUniversity of PittsburghRan2010 to 2013Enrolled87,665ConditionsInfluenzaArms4 Pillars Immunization Toolkit
3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 5 syntheses or guidelines pooled it, 36 citations in OpenAlex.

  1. Audit and feedback: effects on professional practice.The Cochrane database of systematic reviews · 2025
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Trial
  7. Trial
  8. Trial
  9. Development and Evaluation of an HPV Vaccine Champion Training: a Strategy to Boost Adolescent Vaccination in Community Health Centers in Florida.Journal of cancer education : the official journal of the American Association for Cancer Education · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Reducing Racial Disparities in Influenza Vaccination Among Children With Asthma.Journal of pediatric health care : official publication of National Association of Pediatric Nurse Associates & Practitioners
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 3 institutions in 1 country.

Richard K ZimmermanDepartment of Family Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States.
Mary Patricia NowalkDepartment of Family Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States. Electronic address: tnowalk@pitt.edu.
Chyongchiou Jeng LinDepartment of Family Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States.
Kristin HannibalDepartment of Pediatrics, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States.
Krissy K MoehlingDepartment of Family Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States.
Hsin-Hui HuangDepartment of Family Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States.
Annamore MatambanadzoDepartment of Family Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States.
Judith TroyDepartment of Family Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States.
Norma J AllredCenters for Disease Control and Prevention, Atlanta, GA, United States.
Greg GallikShadyside Family Health Center, Pittsburgh, PA, United States.
Evelyn C ReisDepartment of Pediatrics, University of Pittsburgh School of Medicine, Pittsburgh, PA, United States.
University of Pittsburgh · USCenters for Disease Control and Prevention · USShadyside Hospital · US

Funding

UNIVERSITY OF PITTSBURGH CLINICAL AND TRANSLATIONAL SCIENCE INSTITUTE: BPCAUL1RR024153 · NCRR · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI REIS, STEVEN E · 2006 to 2011
$73.9M
University of Pittsburgh Clinical and Translational Science InstituteUL1TR000005 · NCATS · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI REIS, STEVEN E · 2012 to 2015
$50.8M
From Innovation to Solutions: Autodialers, Use of Early Autumn Physicals and VacU01IP000321 · IP · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI ZIMMERMAN, RICHARD K · 2010 to 2012
$801k
NCATS NIH HHS UL1 TR000005NCATS NIH HHS UL1TR000005NCIRD CDC HHS U01 IP000321NCRR NIH HHS UL1 RR024153NCRR NIH HHS UL1RR024153
6 · The paper itself

Abstract

purposeTo increase childhood influenza vaccination rates using a toolkit and early vaccine delivery in a randomized cluster trial.

methodsTwenty primary care practices treating children (range for n=536-8183) were randomly assigned to Intervention and Control arms to test the effectiveness of an evidence-based practice improvement toolkit (4 Pillars Toolkit) and early vaccine supplies for use among disadvantaged children on influenza vaccination rates among children 6 months-18 years. Follow-up staff meetings and surveys were used to assess use and acceptability of the intervention strategies in the Intervention arm. Rates for the 2010-2011 and 2011-2012 influenza seasons were compared. Two-level generalized linear mixed modeling was used to evaluate outcomes.

resultsOverall increases in influenza vaccination rates were significantly greater in the Intervention arm (7.9 percentage points) compared with the Control arm (4.4 percentage points; P<0.034). These rate changes represent 4522 additional doses in the Intervention arm vs. 1390 additional doses in the Control arm. This effect of the intervention was observed despite the fact that rates increased significantly in both arms - 8/10 Intervention (all P<0.001) and 7/10 Control sites (P-values=0.04 to <0.001). Rates in two Intervention sites with pre-intervention vaccination rates >58% did not significantly increase. In regression analyses, a child's likelihood of being vaccinated was significantly higher with: younger age, white race (Odds ratio [OR]=1.29; 95% confidence interval [CI]=1.23-1.34), having commercial insurance (OR=1.30; 95%CI=1.25-1.35), higher pre-intervention practice vaccination rate (OR=1.25; 95%CI=1.16-1.34), and being in the Intervention arm (OR=1.23; 95%CI=1.01-1.50). Early delivery of influenza vaccine was rated by Intervention practices as an effective strategy for raising rates.

conclusionsImplementation of a multi-strategy toolkit and early vaccine supplies can significantly improve influenza vaccination rates among children in primary care practices but the effect may be less pronounced in practices with moderate to high existing vaccination rates. Clinical trial registry name/number: From Innovation to Solutions: Childhood Influenza/NCT01664793.

Indexed as

AdolescentChildChild, PreschoolFemaleHumansImmunization ProgramsInfantInfluenza, HumanInfluenza VaccinesLinear ModelsMaleVaccinationVulnerable PopulationsInfluenza VaccinesChildhood influenza vaccinationChildrenImmunizationInfluenza vaccine

Identifiers

PMID24793941
PMCPMC4070849
OpenAlexW2023198865

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.