Evidence map›Paper›PMID 37348935›Full record

ReviewGlobal health, science and practice2023

Measuring National Immunization System Performance: A Systematic Assessment of Available Resources.

Cyra Patel, Nicole Rendell, Ginny M Sargent, Akeem Ali, Christopher Morgan, Rebecca Fields, Meru Sheel

Open access · diamondAbstract readReview
In one paragraph

Review in Global health, science and practice, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
4.4field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 16 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 4 institutions in 2 countries.

Cyra PatelNational Centre for Epidemiology and Population Health, Australian National University, Acton, Australia. cyra.patel@anu.edu.au.
Nicole RendellNational Centre for Epidemiology and Population Health, Australian National University, Acton, Australia.
Ginny M SargentNational Centre for Epidemiology and Population Health, Australian National University, Acton, Australia.
Akeem AliWorld Health Organization, Seoul, Republic of Korea.
Christopher MorganJhpiego, Baltimore, MD, USA.
Rebecca FieldsJSI Research & Training Institute, Inc., Arlington, VA, USA.
Meru SheelNational Centre for Epidemiology and Population Health, Australian National University, Acton, Australia.
Australian National University · AUBurnet Institute · AUUniversity of Sydney · AUWorld Health Organization - Pakistan · PK

Funding

World Health Organization 001
6 · The paper itself

Abstract

backgroundVaccination coverage is widely used to assess immunization performance but, on its own, provides insufficient information to drive improvements. Assessing the performance of underlying components of immunization systems is less clear, with several monitoring and evaluation (M&E) resources available for use in different operational settings and for different purposes. We studied these resources to understand how immunization system performance is measured.

methodsWe reviewed peer-reviewed and gray literature published since 2000 to identify M&E resources that include national-level indicators measuring the performance of immunization systems or their components (governance, financing, regulation, information systems, vaccine logistics, workforce, service delivery, and demand generation). We summarize indicators by the system components or outcomes measured and describe findings narratively.

resultsWe identified 20 resources to monitor immunization program objectives and guide national strategic decision-making, encompassing 631 distinct indicators. Indicators for immunization program outcomes comprised the majority (124/631 [19.7%]), largely vaccination coverage (110/124 [88.7%]). Almost all resources (19/20 [95%]) included indicators for vaccine logistics (83/631 [13.2%]), and those for regulation (19/631 [3.0%]) and demand generation (28/631 [4.4%]) were least common. There was heterogeneity in how information systems (92/563 [14.6%]) and workforce (47/631 [7.4%]) were assessed across resources. Indicators for vaccination coverage in adults, data use in decision-making, equity and diversity, effectiveness of safety surveillance, and availability of a public health workforce were notably lacking.

conclusionsBetween the resources identified in this review, we identified considerable variability and gaps in indicators assessing the performance of some immunization system components. Given the multitude of indicators, policymakers may be better served by tailoring evaluation resources to their specific context to gain useful insight into health system performance and improve data use in decision-making for immunization programs.

Indexed as

VaccinationVaccinesHumansImmunizationImmunization ProgramsPublic HealthVaccines

Identifiers

PMID37348935
PMCPMC10285727
OpenAlexW4379741535

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.