ArticleImplementation science communications2023
Refining Expert Recommendations for Implementing Change (ERIC) strategy surveys using cognitive interviews with frontline providers.
Article in Implementation science communications, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 4 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
19 citing papers in PubMed, 4 syntheses or guidelines pooled it.
- A Systematic Review of Community Pharmacy-Led Depression Services: Service Components, Outcomes, and Implementation Barriers and Facilitators.Depression and anxiety · 2026Pooled it
- Implementation strategies for WHO guidelines to prevent, detect, and treat postpartum hemorrhage.The Cochrane database of systematic reviews · 2025Pooled it
- Investigating the implementation of infection prevention and control practices in neonatal care across country income levels: a systematic review.Antimicrobial resistance and infection control · 2025Pooled it
- A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022.Implementation science : IS · 2024Pooled it
- Design and implementation of a Type-2 hybrid, prospective randomized trial of opioid agonist therapies integration into primary care clinics in Ukraine.Contemporary clinical trials · 2024Trial
- Exploring multi-level barriers and human-centered solutions to expand methadone for HIV prevention among people who inject drugs in Kyrgyzstan.Journal of substance use and addiction treatment · 2026Article
- Identifying Implementation Gaps in the HIV Prevention Cascade among Peruvian Men Who Have Sex with Men.AIDS and behavior · 2026Article
- A stakeholder engagement method to inform adaptation of a multicomponent hypertension control program in Ghana: A mixed methods study.Implementation science communications · 2026Article
- Exploring factors influencing implementation across the explanatory-to-pragmatic trial continuum: a sequential qualitative integration of delivering higher-intensity walking exercise within inpatient stroke rehabilitation.Implementation science communications · 2026Article
- Article
- Article
- Tailored implementation of a behaviour change intervention for post-stroke physical activity: A mixed-methods feasibility study.Clinical rehabilitation · 2025Article
- Community-driven strategies for implementing suicide prevention education in jails.Psychological services · 2025Article
- Using the implementation research logic model to examine high-intensity resistance rehabilitation implementation in skilled nursing facilities: a mixed methods multi-site case study.Implementation science communications · 2025Article
- Article
- Using an experience-based co-design approach to develop strategies for implementing an intravenous iron intervention to treat moderate and severe anemia in pregnancy in Malawi.Implementation science communications · 2024Article
- "Allowing space for voice…all our voices:" Understanding Ho'ouna Pono implementation through educational leadership perspectives in rural Hawai'i schools.School mental health · 2024Article
- Implementing digital respiratory technologies for people with respiratory conditions: A protocol for a scoping review.PloS one · 2024Article
- Matching barriers and facilitators to implementation strategies: recommendations for community settings.Implementation science communications · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
10 authors.
Funding
Abstract
backgroundThe Expert Recommendations for Implementing Change (ERIC) compilation includes 73 defined implementation strategies clustered into nine content areas. This taxonomy has been used to track implementation strategies over time using surveys. This study aimed to improve the ERIC survey using cognitive interviews with non-implementation scientist clinicians.
methodsStarting in 2015, we developed and fielded annual ERIC surveys to evaluate liver care in the Veterans Health Administration (VA). We invited providers who had completed at least three surveys to participate in cognitive interviews (October 2020 to October 2021). Before the interviews, participants reviewed the complete 73-item ERIC survey and marked which strategies were unclear due to wording, conceptual confusion, or overlap with other strategies. They then engaged in semi-structured cognitive interviews to describe the experience of completing the survey and elaborate on which strategies required further clarification.
resultsTwelve VA providers completed surveys followed by cognitive interviews. The "Engage Consumer" and "Support Clinicians" clusters were rated most highly in terms of conceptual and wording clarity. In contrast, the "Financial" cluster had the most wording and conceptual confusion. The "Adapt and Tailor to Context" cluster strategies were considered to have the most redundancy. Providers outlined ways in which the strategies could be clearer in terms of wording (32%), conceptual clarity (51%), and clarifying the distinction between strategies (51%).
conclusionsCognitive interviews with ERIC survey participants allowed us to identify and address issues with strategy wording, combine conceptually indistinct strategies, and disaggregate multi-barreled strategies. Improvements made to the ERIC survey based on these findings will ultimately assist VA and other institutions in designing, evaluating, and replicating quality improvement efforts.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.