Evidence map›Paper›PMID 38915102›Full record

SynthesisImplementation science : IS2024

A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022.

Laura Ellen Ashcraft, David E Goodrich, Joachim Hero, Angela Phares, Rachel L Bachrach, Deirdre A Quinn, Nabeel Qureshi, Natalie C Ernecoff, Lisa G Lederer, Leslie Page Scheunemann and 2 more

Erratum issuedAbstract readSystematic Review
In one paragraph

Synthesis in Implementation science : IS, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 62 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
62citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

62 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Tailored interventions to address determinants of practice.The Cochrane database of systematic reviews · 2026
    Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

2 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors.

Laura Ellen AshcraftCenter for Health Equity Research and Promotion, Corporal Michael Crescenz VA Medical Center, Philadelphia, PA, USA. lauraellen.ashcraft@pennmedicine.upenn.edu.ORCID 0000-0001-9957-0617
David E GoodrichCenter for Health Equity Research and Promotion, VA Pittsburgh Healthcare System, Pittsburgh, PA, USA.
Joachim HeroRAND Corporation, Pittsburgh, PA, USA.
Angela PharesCenter for Health Equity Research and Promotion, VA Pittsburgh Healthcare System, Pittsburgh, PA, USA.
Rachel L BachrachCenter for Clinical Management Research, VA Ann Arbor Healthcare System, Ann Arbor, Michigan, USA.
Deirdre A QuinnCenter for Health Equity Research and Promotion, VA Pittsburgh Healthcare System, Pittsburgh, PA, USA.
Nabeel QureshiRAND Corporation, Pittsburgh, PA, USA.
Natalie C ErnecoffRAND Corporation, Pittsburgh, PA, USA.
Lisa G LedererClinical & Translational Science Institute, University of Pittsburgh, Pittsburgh, PA, USA.
Leslie Page ScheunemannDivision of Geriatric Medicine, University of Pittsburgh, Department of Medicine, Pittsburgh, PA, USA.
Shari S Rogal *Center for Health Equity Research and Promotion, VA Pittsburgh Healthcare System, Pittsburgh, PA, USA.
Matthew J Chinman *Center for Health Equity Research and Promotion, VA Pittsburgh Healthcare System, Pittsburgh, PA, USA.

Funding

Improving Pain Management and Opioid Safety for Patients with CirrhosisK23DA048182 · NIDA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI ROGAL, SHARI S · 2020 to 2023
$755k
Tele-Recovery: Engaging Stakeholders to Adapt and Pilot Test a Scalable Transitional Rehabilitation Intervention for Older, Rural ICU SurvivorsK08HS027210 · AHRQ · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI SCHEUNEMANN, LESLIE PAGE · 2019 to 2023
$742k
Implementation Intervention to Improve Care for Unhealthy Alcohol UseIK2HX003087 · VA · VETERANS HEALTH ADMINISTRATION · PI BACHRACH, RACHEL LAUREN · 2020 to 2025
–
HSR&D Research Career Scientist AwardIK6HX003767 · VA · VETERANS HEALTH ADMINISTRATION · PI MATTHEW CHINMAN · 2023 to 2026
–
Agency for Healthcare Research and Quality K08HS027210AHRQ HHS K08 HS027210Health Services Research and Development CDA 20-057Health Services Research and Development CDA 20-224Health Services Research and Development PEC 19-207HSRD VA IK2 HX003087HSRD VA IK6 HX003767NIDA NIH HHS K23 DA048182Patient-Centered Outcomes Research Institute AOSEPP2 Task Order 12University of Pittsburgh K23-DA048182VA Center for Health Equity Research and Promotion CIN 13-405
6 · The paper itself

Abstract

backgroundStudies of implementation strategies range in rigor, design, and evaluated outcomes, presenting interpretation challenges for practitioners and researchers. This systematic review aimed to describe the body of research evidence testing implementation strategies across diverse settings and domains, using the Expert Recommendations for Implementing Change (ERIC) taxonomy to classify strategies and the Reach Effectiveness Adoption Implementation and Maintenance (RE-AIM) framework to classify outcomes.

methodsWe conducted a systematic review of studies examining implementation strategies from 2010-2022 and registered with PROSPERO (CRD42021235592). We searched databases using terms "implementation strategy", "intervention", "bundle", "support", and their variants. We also solicited study recommendations from implementation science experts and mined existing systematic reviews. We included studies that quantitatively assessed the impact of at least one implementation strategy to improve health or health care using an outcome that could be mapped to the five evaluation dimensions of RE-AIM. Only studies meeting prespecified methodologic standards were included. We described the characteristics of studies and frequency of implementation strategy use across study arms. We also examined common strategy pairings and cooccurrence with significant outcomes.

findingsOur search resulted in 16,605 studies; 129 met inclusion criteria. Studies tested an average of 6.73 strategies (0-20 range). The most assessed outcomes were Effectiveness (n=82; 64%) and Implementation (n=73; 56%). The implementation strategies most frequently occurring in the experimental arm were Distribute Educational Materials (n=99), Conduct Educational Meetings (n=96), Audit and Provide Feedback (n=76), and External Facilitation (n=59). These strategies were often used in combination. Nineteen implementation strategies were frequently tested and associated with significantly improved outcomes. However, many strategies were not tested sufficiently to draw conclusions.

conclusionThis review of 129 methodologically rigorous studies built upon prior implementation science data syntheses to identify implementation strategies that had been experimentally tested and summarized their impact on outcomes across diverse outcomes and clinical settings. We present recommendations for improving future similar efforts.

Indexed as

Implementation ScienceDelivery of Health CareHumansHealthHealth-related outcomesImplementation strategySystematic review

Identifiers

PMID38915102
PMCPMC11194895

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.