SynthesisImplementation science : IS2020
Quantitative measures of health policy implementation determinants and outcomes: a systematic review.
Synthesis in Implementation science : IS, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 84 papers, 6 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
SUMAMOS EXCELENCIA Project: Assessment of Implementation of Best Practices in a National Health System (Second Edition)
SUMAMOS EXCELENCIA Project: Assessment of Implementation of Best Practices in a National Health System (Thrid Edition)
Who cites it
84 citing papers in PubMed, 6 syntheses or guidelines pooled it.
- A systematic review investigating policy design and implementation of US state and local policy to restrict the sale of flavored tobacco products.Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco · 2026Pooled it
- Evaluation of health technology implementation in the Brazilian public health system: a systematic review.BMC health services research · 2025Pooled it
- What validated instruments, that measure implementation outcomes, are suitable for use in the Paediatric Intensive Care Unit (PICU) setting? A systematic review of systematic reviews.Implementation science : IS · 2024Pooled it
- Analysis and evolution of health policies in Iran through policy triangle framework during the last thirty years: a systematic review of the historical period from 1994 to 2021.Journal of preventive medicine and hygiene · 2023Pooled it
- Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review.Implementation science : IS · 2022Pooled it
- Strategies for effective dissemination of research to United States policymakers: a systematic review.Implementation science : IS · 2020Pooled it
- A scoping review and systems thinking synthesis of scale-up frameworks.BMC health services research · 2026Article
- Assessing the progress in implementing population-based policies to reduce the burden of noncommunicable diseases in Eastern Europe and Central Asia, 2010-2024.Health policy and planning · 2026Article
- Barriers and bottlenecks to implementation of WHO recommendations for prevention, detection, and treatment of postpartum hemorrhage: a mixed-methods triangulation study.Implementation science communications · 2026Article
- "We're building the plane while we're flying it": perspectives on local cigar policy implementation from qualitative interviews with key personnel.Implementation science communications · 2026Article
- Implementation of safe abortion care policy in africa: a scoping review of readiness and outcomes.BMC public health · 2026Article
- Bridging implementation science and policy change: a Global South perspective.Frontiers in health services · 2026Review
- Participatory systems modeling in implementation research: Exploring benefits, facilitators, and future needs.Journal of clinical and translational science · 2026Article
- Policy text analysis of China's smart pharmaceutical regulation under a policy tool-policy stage framework.Frontiers in public health · 2026Article
- Implementation research assessment instruments: a webtool to identify, compare and select assessment instruments connected with implementation science theories, models, and frameworks.Frontiers in health services · 2026Article
- A cluster-randomized controlled trial assessing the effectiveness of a multifaceted versus a discrete implementation strategy on fidelity to an occupational guideline for the prevention of mental health problems at the workplace: a dual perspective from Swedish schools.Implementation science communications · 2025Article
- Sustaining perioperative patient safety improvement: the relevance of patient safety policies and contextual factors in European healthcare systems.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2025Article
- Measures of the Availability and Accessibility of Behavioral Health Services: A Scoping Review.Psychiatric services (Washington, D.C.) · 2025Article
- Service Quality Assessment of Digital Health Solutions in Outpatient Care: Qualitative Item Repository Development Study.JMIR formative research · 2025Article
- Integrating Social Needs into Health Care: An Implementation Science Perspective.Annual review of public health · 2025Review
24 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
12 authors.
Funding
Abstract
backgroundPublic policy has tremendous impacts on population health. While policy development has been extensively studied, policy implementation research is newer and relies largely on qualitative methods. Quantitative measures are needed to disentangle differential impacts of policy implementation determinants (i.e., barriers and facilitators) and outcomes to ensure intended benefits are realized. Implementation outcomes include acceptability, adoption, appropriateness, compliance/fidelity, feasibility, penetration, sustainability, and costs. This systematic review identified quantitative measures that are used to assess health policy implementation determinants and outcomes and evaluated the quality of these measures.
methodsThree frameworks guided the review: Implementation Outcomes Framework (Proctor et al.), Consolidated Framework for Implementation Research (Damschroder et al.), and Policy Implementation Determinants Framework (Bullock et al.). Six databases were searched: Medline, CINAHL Plus, PsycInfo, PAIS, ERIC, and Worldwide Political. Searches were limited to English language, peer-reviewed journal articles published January 1995 to April 2019. Search terms addressed four levels: health, public policy, implementation, and measurement. Empirical studies of public policies addressing physical or behavioral health with quantitative self-report or archival measures of policy implementation with at least two items assessing implementation outcomes or determinants were included. Consensus scoring of the Psychometric and Pragmatic Evidence Rating Scale assessed the quality of measures.
resultsDatabase searches yielded 8417 non-duplicate studies, with 870 (10.3%) undergoing full-text screening, yielding 66 studies. From the included studies, 70 unique measures were identified to quantitatively assess implementation outcomes and/or determinants. Acceptability, feasibility, appropriateness, and compliance were the most commonly measured implementation outcomes. Common determinants in the identified measures were organizational culture, implementation climate, and readiness for implementation, each aspects of the internal setting. Pragmatic quality ranged from adequate to good, with most measures freely available, brief, and at high school reading level. Few psychometric properties were reported.
conclusionsWell-tested quantitative measures of implementation internal settings were under-utilized in policy studies. Further development and testing of external context measures are warranted. This review is intended to stimulate measure development and high-quality assessment of health policy implementation outcomes and determinants to help practitioners and researchers spread evidence-informed policies to improve population health. REGISTRATION: Not registered.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.