SynthesisImplementation science : IS2017
Toward criteria for pragmatic measurement in implementation research and practice: a stakeholder-driven approach using concept mapping.
Synthesis in Implementation science : IS, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 61 papers, 4 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
61 citing papers in PubMed, 4 syntheses or guidelines pooled it.
- Determinants of Implementing Evidence-Based Trauma-Focused Interventions for Children and Youth: A Systematic Review.Administration and policy in mental health · 2020Pooled it
- Implementation outcome instruments for use in physical healthcare settings: a systematic review.Implementation science : IS · 2020Pooled it
- Quantitative measures of health policy implementation determinants and outcomes: a systematic review.Implementation science : IS · 2020Pooled it
- A systematic review of empirical studies examining mechanisms of implementation in health.Implementation science : IS · 2020Pooled it
- Pragmatic Trials in Long-Term Care: Research Challenges and Potential Solutions in Relation to Key Areas of Care.Journal of the American Medical Directors Association · 2022Trial
- Telehealth to Enhance PrEP Awareness Among Women Who Sell Sex: A Community-Embedded Approach.AIDS and behavior · 2026Article
- A Pilot Randomized Controlled Trial of the Autism Mentorship Program.Journal of autism and developmental disorders · 2026Article
- Self-report methods for the assessment of implementation determinants: Reflections on the CFIR user guide.Implementation science : IS · 2026Article
- Article
- Article
- Measuring Implementation Outcomes Change Over Time Using an Adapted Checklist for Assessing Readiness to Implement (CARI).AIDS and behavior · 2025Article
- Evaluation of the impact of a digital care navigator on increasing patient registration with digital mental health interventions in routine care.Internet interventions · 2024Article
- Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT).Implementation science communications · 2024Article
- "Allowing space for voice…all our voices:" Understanding Ho'ouna Pono implementation through educational leadership perspectives in rural Hawai'i schools.School mental health · 2024Article
- What do you think it means? Using cognitive interviewing to improve measurement in implementation science: description and case example.Implementation science communications · 2024Article
- Systematic review of applications and properties of the NoMAD instrument for assessing implementation outcomes: Study protocol.NIHR open research · 2024Article
- Study protocol: Novel Methods for Implementing Measurement-Based Care with youth in Low-Resource Environments (NIMBLE).Implementation science communications · 2023Article
- Evaluating the pragmatic characteristics of advance care planning outcome measures in dementia clinical trials: A scoping review.Journal of the American Geriatrics Society · 2023Article
- Comparing the CFIR-ERIC matching tool recommendations to real-world strategy effectiveness data: a mixed-methods study in the Veterans Health Administration.Implementation science : IS · 2023Article
- German GPs' Self-Perceived Role in the COVID-19 Pandemic: Leadership, Participation in Regional Services and Preferences for Future Pandemic Preparedness.International journal of environmental research and public health · 2023Article
1 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
10 authors.
Funding
Abstract
backgroundAdvancing implementation research and practice requires valid and reliable measures of implementation determinants, mechanisms, processes, strategies, and outcomes. However, researchers and implementation stakeholders are unlikely to use measures if they are not also pragmatic. The purpose of this study was to establish a stakeholder-driven conceptualization of the domains that comprise the pragmatic measure construct. It built upon a systematic review of the literature and semi-structured stakeholder interviews that generated 47 criteria for pragmatic measures, and aimed to further refine that set of criteria by identifying conceptually distinct categories of the pragmatic measure construct and providing quantitative ratings of the criteria's clarity and importance.
methodsTwenty-four stakeholders with expertise in implementation practice completed a concept mapping activity wherein they organized the initial list of 47 criteria into conceptually distinct categories and rated their clarity and importance. Multidimensional scaling, hierarchical cluster analysis, and descriptive statistics were used to analyze the data.
findingsThe 47 criteria were meaningfully grouped into four distinct categories: (1) acceptable, (2) compatible, (3) easy, and (4) useful. Average ratings of clarity and importance at the category and individual criteria level will be presented.
conclusionsThis study advances the field of implementation science and practice by providing clear and conceptually distinct domains of the pragmatic measure construct. Next steps will include a Delphi process to develop consensus on the most important criteria and the development of quantifiable pragmatic rating criteria that can be used to assess measures.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.