Evidence map›Paper›PMID 36309715›Full record

ArticleImplementation science communications2022

"We start where we are": a qualitative study of barriers and pragmatic solutions to the assessment and reporting of implementation strategy fidelity.

Christopher F Akiba, Byron J Powell, Brian W Pence, Kate Muessig, Carol E Golin, Vivian Go

Abstract read
In one paragraph

Article in Implementation science communications, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Christopher F AkibaRTI International, Research Triangle Park, NC, USA. cakiba@rti.org.ORCID http://orcid.org/0000-0002-9434-815X
Byron J PowellCenter for Mental Health Services Research, Brown School, Washington University in St. Louis, St. Louis, MO, USA.
Brian W PenceDepartment of Epidemiology, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Kate MuessigDepartment of Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Carol E GolinDepartment of Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Vivian GoDepartment of Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.

Funding

Virology, Immunology, and Microbiology CoreP30AI050410 · NIAID · UNIV OF NORTH CAROLINA CHAPEL HILL · PI DAVID M. MARGOLIS · 2001 to 2026
$76.9M
Sub-Saharan Africa Regional Partnership (SHARP) for Mental Health Capacity Building - Scale-Up ComponentU19MH113202 · NIMH · UNIV OF NORTH CAROLINA CHAPEL HILL · PI HOSSEINIPOUR, MINA CHRISTINE, PENCE, BRIAN W · 2017 to 2021
$4.1M
MECHANISMS: The MECHANics of Implementation Strategies and MeasureSR01CA262325 · NCI · UNIVERSITY OF WASHINGTON · PI WEINER, BRYAN J. · 2021 to 2023
$2.2M
Vietnam Implementation Science Advancement: A Training Program to Improve HIV Prevention and CareD43TW011548 · FIC · UNIV OF NORTH CAROLINA CHAPEL HILL · PI VIVIAN F. GO, Huong Thi Le · 2021 to 2026
$1.7M
FIC NIH HHS 5D43TW011548-02FIC NIH HHS D43 TW011548NCI NIH HHS R01 CA262325NIAID NIH HHS P30 AI050410NIMH NIH HHS 5U19MH113202-05NIMH NIH HHS U19 MH113202
6 · The paper itself

Abstract

backgroundFidelity measurement of implementation strategies is underdeveloped and underreported, and the level of reporting is decreasing over time. Failing to properly measure the factors that affect the delivery of an implementation strategy may obscure the link between a strategy and its outcomes. Barriers to assessing and reporting implementation strategy fidelity among researchers are not well understood. The aims of this qualitative study were to identify barriers to fidelity measurement and pragmatic pathways towards improvement.

methodsWe conducted in-depth interviews among researchers conducting implementation trials. We utilized a theory-informed interview approach to elicit the barriers and possible solutions to implementation strategy fidelity assessment and reporting. Reflexive-thematic analysis guided coding and memo-writing to determine key themes regarding barriers and solutions.

resultsTwenty-two implementation researchers were interviewed. Participants agreed that implementation strategy fidelity was an essential element of implementation trials and that its assessment and reporting should improve. Key thematic barriers focused on (1) a current lack of validated fidelity tools with the need to assess fidelity in the short term, (2) the complex nature of some implementation strategies, (3) conceptual complications when assessing fidelity within mechanisms-focused implementation research, and (4) structural issues related to funding and publishing. Researchers also suggested pragmatic solutions to overcome each barrier. Respondents reported using specification and tracking data in the short term until validated tools become available. Participants suggested that researchers with strategy-specific content expertise lead the way in identifying core components and setting fidelity requirements for them. Addressing the third barrier, participants provided examples of what pragmatic prospective and retrospective fidelity assessments might look like along a mechanistic pathway. Finally, researchers described approaches to minimize costs of data collection, as well as more structural accountability like adopting and enforcing reporting guidelines or changing the structure of funding opportunities. DISCUSSION: We propose short- and long-term priorities for improving the assessment and reporting of implementation strategy fidelity and the quality of implementation research.

conclusionsA better understanding of the barriers to implementation strategy fidelity assessment may pave the way towards pragmatic solutions.

Indexed as

Implementation strategy fidelityMechanismsSpecificationTracking

Identifiers

PMID36309715
PMCPMC9617230

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.