Evidence map›Paper›PMID 34174834›Full record

ArticleBMC medical research methodology2021

Strengthening methods for tracking adaptations and modifications to implementation strategies.

Amber D Haley, Byron J Powell, Callie Walsh-Bailey, Molly Krancari, Inga Gruß, Christopher M Shea, Arwen Bunce, Miguel Marino, Leah Frerichs, Kristen Hassmiller Lich and 1 more

Registry-linked trialAbstract read
In one paragraph

Article in BMC medical research methodology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03607617 (ASCEND), which is not on this map. Cited by 34 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03607617 completednot on this map

ASCEND: ApproacheS to CHC ImplEmeNtation of SDH Data Collection and Action

TypeobservationalSponsorKaiser PermanenteRan2018 to 2023Enrolled31ConditionsDiabetes MellitusArmsSDH Tool
3 · Its place in the literature

Who cites it

34 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Tailored interventions to address determinants of practice.The Cochrane database of systematic reviews · 2026
    Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Impacts of pragmatic implementation science in a primary care laboratory.Journal of clinical and translational science · 2025
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Analysis ofLearning health systems · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Amber D HaleyGillings School of Global Public Health, University of North Carolina at Chapel Hill, 1105C McGavran-Greenberg Hall, Chapel Hill, NC, 27599-7411, USA. ahaley@live.unc.edu.
Byron J PowellGeorge Warren Brown School, Washington University in St. Louis, 1 Brookings Dr, St. Louis, MO, 63130, USA.
Callie Walsh-BaileyGeorge Warren Brown School, Washington University in St. Louis, 1 Brookings Dr, St. Louis, MO, 63130, USA.
Molly KrancariOCHIN, Inc, 1881 SW Naito Pkwy, Portland, OR, 97201, USA.
Inga GrußKaiser Permanente, Center for Health Research, 3800 N. Interstate Ave, Portland, OR, 97227, USA.
Christopher M SheaGillings School of Global Public Health, University of North Carolina at Chapel Hill, 1105C McGavran-Greenberg Hall, Chapel Hill, NC, 27599-7411, USA.
Arwen BunceOCHIN, Inc, 1881 SW Naito Pkwy, Portland, OR, 97201, USA.
Miguel MarinoOregon Health and Science University, 3181 S.W. Sam Jackson Park Rd., Portland, OR, 97239, USA.
Leah FrerichsGillings School of Global Public Health, University of North Carolina at Chapel Hill, 1105C McGavran-Greenberg Hall, Chapel Hill, NC, 27599-7411, USA.
Kristen Hassmiller LichGillings School of Global Public Health, University of North Carolina at Chapel Hill, 1105C McGavran-Greenberg Hall, Chapel Hill, NC, 27599-7411, USA.
Rachel GoldOCHIN, Inc, 1881 SW Naito Pkwy, Portland, OR, 97201, USA.

Funding

Research ProgramP50CA244289 · NCI · OREGON HEALTH & SCIENCE UNIVERSITY · PI GOLD, RACHEL · 2019 to 2023
$7.6M
ASCEND: ApproacheS to CHC ImplEmeNtation of SDH Data Collection and ActionR18DK114701 · NIDDK · KAISER FOUNDATION RESEARCH INSTITUTE · PI GOLD, RACHEL · 2017 to 2021
$3.5M
IMPROVING THE IMPLEMENTATION AND SUSTAINMENT OF EBPS IN MENTAL HEALTH: DEVELOPING AND PILOTING THE COLLABORATIVE ORGANIZATIONAL APPROACH TO SELECTING AND TAILORING IMPLEMENTATION STRATEGIES (COAST-ISK01MH113806 · NIMH · WASHINGTON UNIVERSITY · PI POWELL, BYRON JAMES · 2017 to 2020
$697k
NCI NIH HHS P50 CA244289NIDDK NIH HHS R18 DK114701NIMH NIH HHS K01 MH113806
6 · The paper itself

Abstract

backgroundDeveloping effective implementation strategies requires adequate tracking and reporting on their application. Guidelines exist for defining and reporting on implementation strategy characteristics, but not for describing how strategies are adapted and modified in practice. We built on existing implementation science methods to provide novel methods for tracking strategy modifications.

methodsThese methods were developed within a stepped-wedge trial of an implementation strategy package designed to help community clinics adopt social determinants of health-related activities: in brief, an 'Implementation Support Team' supports clinics through a multi-step process. These methods involve five components: 1) describe planned strategy; 2) track its use; 3) monitor barriers; 4) describe modifications; and 5) identify / describe new strategies. We used the Expert Recommendations for Implementing Change taxonomy to categorize strategies, Proctor et al.'s reporting framework to describe them, the Consolidated Framework for Implementation Research to code barriers / contextual factors necessitating modifications, and elements of the Framework for Reporting Adaptations and Modifications-Enhanced to describe strategy modifications.

resultsWe present three examples of the use of these methods: 1) modifications made to a facilitation-focused strategy (clinics reported that certain meetings were too frequent, so their frequency was reduced in subsequent wedges); 2) a clinic-level strategy addition which involved connecting one study clinic seeking help with community health worker-related workflows to another that already had such a workflow in place; 3) a study-level strategy addition which involved providing assistance in overcoming previously encountered (rather than de novo) challenges.

conclusionsThese methods for tracking modifications made to implementation strategies build on existing methods, frameworks, and guidelines; however, as none of these were a perfect fit, we made additions to several frameworks as indicated, and used certain frameworks' components selectively. While these methods are time-intensive, and more work is needed to streamline them, they are among the first such methods presented to implementation science. As such, they may be used in research on assessing effective strategy modifications and for replication and scale-up of effective strategies. We present these methods to guide others seeking to document implementation strategies and modifications to their studies.

trial registrationclinicaltrials.gov ID: NCT03607617 (first posted 31/07/2018).

Indexed as

Delivery of Health CareImplementation ScienceHumansImplementation contextImplementation strategiesModification and adaptationReporting

Identifiers

PMID34174834
PMCPMC8235850

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.