SynthesisImplementation science : IS2020
Implementation outcome instruments for use in physical healthcare settings: a systematic review.
Synthesis in Implementation science : IS, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 51 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
51 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- What validated instruments, that measure implementation outcomes, are suitable for use in the Paediatric Intensive Care Unit (PICU) setting? A systematic review of systematic reviews.Implementation science : IS · 2024Pooled it
- Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review.Implementation science : IS · 2022Pooled it
- The Better By Moving study: A multifaceted intervention to improve physical activity in adults during hospital stay.Clinical rehabilitation · 2022Trial
- Validating DigiHEALTHQUAL for measuring digital health effects on service quality in outpatient care in Germany.NPJ digital medicine · 2026Article
- Adoption of a novel biomarker-guided quality improvement treatment bundle for patients with subclinical acute kidney injury after cardiac surgery: An implementation study.European journal of anaesthesiology · 2026Article
- A Formative Evaluation of Parental Perceptions Related to Acceptability, Appropriateness, Feasibility, and Reported Use of an e-Learning Resource Targeting Diet in the First 1000 Days: Survey Study.JMIR formative research · 2026Article
- mHealth Intervention to Promote Nonexercise Physical Activity in Patients With Type 2 Diabetes: Secondary Analysis and Implementation Study.JMIR formative research · 2026Article
- A conceptual framework for integrating HIV, STIs and pregnancy prevention services in Vhembe District, Limpopo, South Africa: improving teenagers' health outcomes.BMC public health · 2026Article
- Mining corridors as emergence interfaces: an evidence-informed one health operational framework for prevention of infectious disease outbreaks in Kédougou, Senegal.Frontiers in public health · 2026Review
- A multicentre validation study of the Swedish version of the Normalization Process Theory Measure S-NoMAD.Implementation science communications · 2025Article
- Cultural Spanish adaptation, factor structure, and reliability of implementation science instruments for suicide prevention.Psychological services · 2025Article
- Article
- Adaptations to implementation frameworks for minority ethnic groups to improve health equity: systematic scoping review.BJPsych open · 2025Review
- Service Quality Assessment of Digital Health Solutions in Outpatient Care: Qualitative Item Repository Development Study.JMIR formative research · 2025Article
- Integrating Implementation Outcomes into Effectiveness Studies: A Practical Guide for Clinical Interventionists.Journal of general internal medicine · 2025Article
- Development and testing of an interactive evaluation tool: the Evaluating QUality and ImPlementation (EQUIP) Tool.Implementation science communications · 2025Article
- Rapid response systems, antibiotic stewardship and medication reconciliation: a scoping review on implementation factors, activities and outcomes.BMJ quality & safety · 2025Article
- 'Mind the Gap'-A Survey on Care Gaps and Priorities for the Transition to Adult Healthcare According to Caregivers of Young People With Rare Conditions Associated With Intellectual Disability.Journal of intellectual disability research : JIDR · 2025Article
- Assessing the readiness and feasibility to implement a model of care for spine disorders and related disability in Cross Lake, an Indigenous community in northern Manitoba, Canada: a research protocol.Chiropractic & manual therapies · 2025Article
- Development of an instrument (Cost-IS) to estimate costs of implementation strategies for digital health solutions: a modified e-Delphi study.Implementation science : IS · 2025Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
9 authors.
Funding
Abstract
backgroundImplementation research aims to facilitate the timely and routine implementation and sustainment of evidence-based interventions and services. A glaring gap in this endeavour is the capability of researchers, healthcare practitioners and managers to quantitatively evaluate implementation efforts using psychometrically sound instruments. To encourage and support the use of precise and accurate implementation outcome measures, this systematic review aimed to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings.
methodThe following data sources were searched from inception to March 2019, with no language restrictions: MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL and the Cochrane library. Studies that evaluated the measurement properties of implementation outcome instruments in physical healthcare settings were eligible for inclusion. Proctor et al.'s taxonomy of implementation outcomes was used to guide the inclusion of implementation outcomes: acceptability, appropriateness, feasibility, adoption, penetration, implementation cost and sustainability. Methodological quality of the included studies was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Psychometric quality of the included instruments was assessed using the Contemporary Psychometrics checklist (ConPsy). Usability was determined by number of items per instrument.
resultsFifty-eight publications reporting on the measurement properties of 55 implementation outcome instruments (65 scales) were identified. The majority of instruments assessed acceptability (n = 33), followed by appropriateness (n = 7), adoption (n = 4), feasibility (n = 4), penetration (n = 4) and sustainability (n = 3) of evidence-based practice. The methodological quality of individual scales was low, with few studies rated as 'excellent' for reliability (6/62) and validity (7/63), and both studies that assessed responsiveness rated as 'poor' (2/2). The psychometric quality of the scales was also low, with 12/65 scales scoring 7 or more out of 22, indicating greater psychometric strength. Six scales (6/65) rated as 'excellent' for usability.
conclusionInvestigators assessing implementation outcomes quantitatively should select instruments based on their methodological and psychometric quality to promote consistent and comparable implementation evaluations. Rather than developing ad hoc instruments, we encourage further psychometric testing of instruments with promising methodological and psychometric evidence. SYSTEMATIC REVIEW REGISTRATION: PROSPERO 2017 CRD42017065348.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.