Evidence map›Paper›PMID 33588878›Full record

ArticleImplementation science : IS2021

Understanding the implementation of evidence-informed policies and practices from a policy perspective: a critical interpretive synthesis.

Heather L Bullock, John N Lavis, Michael G Wilson, Gillian Mulvale, Ashleigh Miatello

Abstract read
In one paragraph

Article in Implementation science : IS, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 87 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
87citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

87 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. A systematic review investigating policy design and implementation of US state and local policy to restrict the sale of flavored tobacco products.Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Article
  8. Article
  9. Article
  10. Article
  11. Barriers and facilitators to enforcing E-cigarette regulations for online sales.Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco · 2026
    Article
  12. Review
  13. Article
  14. Article
  15. Minimum Legal Sales Age for e-Cigarettes: a Qualitative Study on the Implementation of Model Policy Components.Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco · 2026
    Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article

27 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Heather L BullockDepartment of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada. bullochl@mcmaster.ca.ORCID 0000-0002-3657-6525
John N LavisDepartment of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.
Michael G WilsonDepartment of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.
Gillian MulvaleDeGroote School of Business, McMaster University, Burlington, Canada.
Ashleigh MiatelloDepartment of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario, L8S 4L6, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe fields of implementation science and knowledge translation have evolved somewhat independently from the field of policy implementation research, despite calls for better integration. As a result, implementation theory and empirical work do not often reflect the implementation experience from a policy lens nor benefit from the scholarship in all three fields. This means policymakers, researchers, and practitioners may find it challenging to draw from theory that adequately reflects their implementation efforts.

methodsWe developed an integrated theoretical framework of the implementation process from a policy perspective by combining findings from these fields using the critical interpretive synthesis method. We began with the compass question: How is policy currently described in implementation theory and processes and what aspects of policy are important for implementation success? We then searched 12 databases as well as gray literature and supplemented these documents with other sources to fill conceptual gaps. Using a grounded and interpretive approach to analysis, we built the framework constructs, drawing largely from the theoretical literature and then tested and refined the framework using empirical literature.

resultsA total of 11,434 documents were retrieved and assessed for eligibility and 35 additional documents were identified through other sources. Eighty-six unique documents were ultimately included in the analysis. Our findings indicate that policy is described as (1) the context, (2) a focusing lens, (3) the innovation itself, (4) a lever of influence, (5) an enabler/facilitator or barrier, or (6) an outcome. Policy actors were also identified as important participants or leaders of implementation. Our analysis led to the development of a two-part conceptual framework, including process and determinant components.

conclusionsThis framework begins to bridge the divide between disciplines and provides a new perspective about implementation processes at the systems level. It offers researchers, policymakers, and implementers a new way of thinking about implementation that better integrates policy considerations and can be used for planning or evaluating implementation efforts.

Indexed as

Health PolicyHumansCritical interpretive synthesisEvidence-based health careImplementation sciencePublic policySystematic review

Identifiers

PMID33588878
PMCPMC7885555

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.