Evidence map›Paper›PMID 37858215›Full record

ArticleImplementation science communications2023

A structured approach to applying systems analysis methods for examining implementation mechanisms.

Bo Kim, Gracelyn Cruden, Erika L Crable, Andrew Quanbeck, Brian S Mittman, Anjuli D Wagner

Abstract read
In one paragraph

Article in Implementation science communications, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Tools to improve discharge equity: Protocol for the pilot TIDE trial.Contemporary clinical trials communications · 2025
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Bo KimVA Boston Healthcare System, 150 South Huntington Avenue, Boston, MA, 02130, USA. bo.kim@va.gov.ORCID http://orcid.org/0000-0001-7730-1627
Gracelyn CrudenChestnut Health Systems, Lighthouse Institute-Oregon Group, 1255 Pearl Street, Eugene, OR, 97401, USA.
Erika L CrableUC San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA.
Andrew QuanbeckUniversity of Wisconsin-Madison, 610 North Whitney Way, Madison, WI, 53705, USA.
Brian S MittmanKaiser Permanente Southern California, 200 North Lewis Street, Orange, CA, 92868, USA.
Anjuli D WagnerUniversity of Washington, 3980 15Th Avenue NE, Seattle, WA, 98195, USA.

Funding

IMPLEMENTATION RESEARCH INSTITUTE FOR MENTAL HEALTH SERVICES IRI-MHSR25MH080916 · NIMH · WASHINGTON UNIVERSITY · PI Byron James Powell · 2009 to 2026
$3.7M
The Lifespan/Brown Criminal Justice Research Program on Substance Use and HIVR25DA037190 · NIDA · MIRIAM HOSPITAL · PI CURT G BECKWITH · 2014 to 2026
$3.5M
Policy Dissemination Strategies to Improve the Use of Research Evidence in Medicaid Benefits for Opioid Use Disorder TreatmentK01DA056838 · NIDA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI Erika Lynn Crable · 2022 to 2026
$914k
Refining and Pilot Testing a Decision Support Intervention to Facilitate Adoption of Evidence-Based Programs to Improve Parent and Child Mental HealthK01MH128761 · NIMH · OSLC DEVELOPMENTS · PI Gracelyn Cruden · 2022 to 2026
$843k
Testing implementation strategies to improve delivery of PrEP for pregnant and postpartum women in KenyaK01MH121124 · NIMH · UNIVERSITY OF WASHINGTON · PI WAGNER, ANJULI DAWN · 2019 to 2023
$835k
AHRQ HHS R13 HS025632NIDA NIH HHS K01 DA056838NIDA NIH HHS K01 DA056838-01NIDA NIH HHS R25 DA037190NIMH NIH HHS K01 MH121124NIMH NIH HHS K01 MH128761NIMH NIH HHS R25 MH080916
6 · The paper itself

Abstract

backgroundIt is challenging to identify and understand the specific mechanisms through which an implementation strategy affects implementation outcomes, as implementation happens in the context of complex, multi-level systems. These systems and the mechanisms within each level have their own dynamic environments that change frequently. For instance, sequencing may matter in that a mechanism may only be activated indirectly by a strategy through another mechanism. The dosage or strength of a mechanism may vary over time or across different health care system levels. To elucidate the mechanisms relevant to successful implementation amidst this complexity, systems analysis methods are needed to model and manage complexity.

methodsThe fields of systems engineering and systems science offer methods-which we refer to as systems analysis methods-to help explain the interdependent relationships between and within systems, as well as dynamic changes to systems over time. When applied to studying implementation mechanisms, systems analysis methods can help (i) better identify and manage unknown conditions that may or may not activate mechanisms (both expected mechanisms targeted by a strategy and unexpected mechanisms that the methods help detect) and (ii) flexibly guide strategy adaptations to address contextual influences that emerge after the strategy is selected and used.

resultsIn this paper, we delineate a structured approach to applying systems analysis methods for examining implementation mechanisms. The approach includes explicit steps for selecting, tailoring, and evaluating an implementation strategy regarding the mechanisms that the strategy is initially hypothesized to activate, as well as additional mechanisms that are identified through the steps. We illustrate the approach using a case example. We then discuss the strengths and limitations of this approach, as well as when these steps might be most appropriate, and suggest work to further the contributions of systems analysis methods to implementation mechanisms research.

conclusionsOur approach to applying systems analysis methods can encourage more mechanisms research efforts to consider these methods and in turn fuel both (i) rigorous comparisons of these methods to alternative mechanisms research approaches and (ii) an active discourse across the field to better delineate when these methods are appropriate for advancing mechanisms-related knowledge.

Indexed as

Health care systemsImplementation mechanismsImplementation strategiesSystems engineeringSystems science

Identifiers

PMID37858215
PMCPMC10588196

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.