ArticleImplementation science communications2020
Advancing the pragmatic measurement of sustainment: a narrative review of measures.
Article in Implementation science communications, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 42 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
42 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Exploring long-term follow-up of effective implementation trials in schools: a secondary review.Frontiers in public health · 2026Pooled it
- Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review.Implementation science : IS · 2022Pooled it
- Postpandemic Use of Video-Based Psychotherapy Among German Outpatient Psychotherapists: Repeated Cross-Sectional and Partially Longitudinal Survey Study.Journal of medical Internet research · 2026Article
- Sustainability and normalization of an intervention to improve evidence-based myocardial infarction care in Tanzania.Implementation science communications · 2026Article
- A qualitative assessment of readiness to sustain Rapid Start ART in 14 publicly funded HIV clinics in the United States.Implementation science communications · 2026Article
- Toward the sustainability of health care innovations to "transform our world": current status and the road ahead.JBI evidence implementation · 2026Article
- Minimal progress toward sustainment: 10-year replication of substance use EBP sustainment trajectories and associations with implementation characteristics.Implementation science : IS · 2025Article
- The development of the sustainability measure for healthcare using a modified Delphi process.BMC health services research · 2025Article
- Sustainability and normalization of an intervention to improve evidence-based myocardial infarction care in Tanzania.Research square · 2025Article
- Developing an evaluation tool for the impact of consumer partnerships in healthcare governance: a coproduced mixed methods study.BMJ open quality · 2025Article
- The role of organizational characteristics in intervention sustainment: findings from a quantitative analysis in 42 HIV testing clinics in Vietnam.Implementation science communications · 2025Article
- Sustainability of fall prevention exercise programmes for community-dwelling older adults: a scoping review protocol.BMJ open · 2025Article
- Article
- A cross-sectional study assessing barriers and facilitators to the sustainability of physical activity and nutrition interventions in early childhood education and care settings.The international journal of behavioral nutrition and physical activity · 2025Article
- Longitudinal exploration of the delivery of care following a successful antenatal practice change intervention.Frontiers in medicine · 2025Article
- Advancing sustainability in low-resource settings: development and validation of a sustainability tool for evidence-based interventions and programs.Frontiers in health services · 2025Article
- Implementation Science in School Mental Health: A 10-Year Progress Update and Development of a New Research Agenda.School mental health · 2024Article
- Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT).Implementation science communications · 2024Article
- Mobilizing strategic inflection points for sustainment of an effective intervention in an integrated learning health system: an interpretive description.Implementation science communications · 2024Article
- Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C): development and psychometric evaluation of a measure of sustainability determinants in the early childhood education and care setting.Implementation science : IS · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
7 authors.
Funding
Abstract
backgroundSustainment, an outcome indicating an intervention continues to be implemented over time, has been comparatively less studied than other phases of the implementation process. This may be because of methodological difficulties, funding cycles, and minimal attention to theories and measurement of sustainment. This review synthesizes the literature on sustainment measures, evaluates the qualities of each measure, and highlights the strengths and gaps in existing sustainment measures. Results of the review will inform recommendations for the development of a pragmatic, valid, and reliable measure of sustainment.
methodsA narrative review of published sustainment outcome and sustainability measures (i.e., factors that influence sustainment) was conducted, including appraising measures in the Society of Implementation Research Collaboration (SIRC) instrument review project (IRP) and the Dissemination and Implementation Grid-Enabled Measures database initiative (GEM-D&I). The narrative review used a snowballing strategy by searching the reference sections of literature reviews and definitions of sustainability and sustainment. Measures used frequently and judged to be comprehensive and/or validated by a team of implementation scientists were extracted for analysis.
resultsEleven measures were evaluated. Three of the included measures were found in the SIRC-IRP, three in the GEM-D&I database, (one measure was in both databases) and six were identified in our additional searches. Thirteen constructs relating to sustainment were coded from selected measures. Measures covered a range of determinants for sustainment (i.e., construct of sustainability) as well as constructs of sustainment as an outcome. Strengths of the measures included, development by expert panels knowledgeable about particular interventions, fields or contexts, and utility in specific scenarios. A number of limitations were found in the measures analyzed including inadequate assessment of psychometric characteristics, being overly intervention or context specific, being lengthy and/or complex, and focusing on outer context factors.
conclusionThere is a lack of pragmatic and psychometrically sound measures of sustainment that can be completed by implementation stakeholders within inner context settings (e.g., frontline providers, supervisors).
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.