Evidence map›Paper›PMID 32883352›Full record

ArticleImplementation science : IS2020

Measurement of sustainment of prevention programs and initiatives: the sustainment measurement system scale.

Lawrence A Palinkas, Chih-Ping Chou, Suzanne E Spear, Sapna J Mendon, Juan Villamar, C Hendricks Brown

Abstract read
In one paragraph

Article in Implementation science : IS, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 35 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
35citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

35 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Lawrence A PalinkasSuzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles, CA, USA. Palinkas@usc.edu.ORCID 0000-0003-0974-7330
Chih-Ping ChouDepartment of Preventive Medicine, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA.
Suzanne E SpearDepartment of Health Sciences, California State University, Northridge, CA, USA.
Sapna J MendonSuzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles, CA, USA.
Juan VillamarCenter for Prevention Implementation Methodology (Ce-PIM) for Drug Abuse and HIV, Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
C Hendricks BrownCenter for Prevention Implementation Methodology (Ce-PIM) for Drug Abuse and HIV, Department of Psychiatry and Behavioral Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.

Funding

Northwestern University Clinical and Translational Science Institute (NUCATS)UL1TR001422 · NCATS · NORTHWESTERN UNIVERSITY AT CHICAGO · PI D'AQUILA, RICHARD · 2015 to 2023
$56.8M
Global Mental Health Research Fellowship: Interventions That Make a DifferenceT32MH096724 · NIMH · NEW YORK STATE PSYCHIATRIC INSTITUTE DBA RESEARCH FOUNDATION FOR MENTAL HYGIENE, INC · PI MILTON L WAINBERG · 2012 to 2026
$4.4M
Measuring Sustainment in Prevention Programs and InitiativesR34DA037516 · NIDA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI PALINKAS, LAWRENCE A · 2015 to 2017
$827k
NCATS NIH HHS UL1 TR001422NIDA NIH HHS P30 DA02878NIDA NIH HHS R34 DA037516NIDA NIH HHS R34 DA037516-01A1NIMH NIH HHS T32 MH096724
6 · The paper itself

Abstract

backgroundEnhancing the sustainability of evidence-based prevention programs for mental and behavioral health requires tools for measuring both sustainability determinants and sustainment outcomes. The aim of this study was to develop the Sustainment Measurement System Scale (SMSS) and to assess its reliability and construct validity for measuring both determinants and outcomes of efforts to sustain prevention programs and initiatives.

methodsA 42-item scale comprised of items identified from qualitative data collected from 45 representatives of 10 programs and 8 SAMHSA program officers was administered to 186 representatives of 145 programs funded by 7 SAMHSA prevention grant initiatives. Cronbach's alphas were used to determine inter-item reliability. Convergent validity was assessed by comparisons of a global measure of sustainment with current SAMHSA-funding status and continued operation in the same form. Discriminant validity was assessed by comparisons of sustainability determinants with whether or not the program had undergone adaptations.

resultsConfirmatory factor analysis provided support for a 35-item model fit to the data. Cronbach's alpha was .84 for the sustainment outcome construct and ranged from .70 to .93 for the sustainability determinant constructs. All of the determinant constructs were significantly associated with sustainment outcome individual and global measures for the entire sample (p < 0.01 to 0.001) and for community-based programs and programs with a substance abuse focus (p < 0.05 to 0.001). Convergent validity was supported by significant associations between the global sustainment measure and current SAMHSA funding status and continued operation in the same form (p < 0.001). Four of the sustainability determinant constructs (responsive to community needs; coalitions, partnerships, and networks; organizational staff capability; and evaluation, feedback, and program outcomes) were also significantly associated with current SAMHSA funding status (p < 0.5 to 0.01). With the exception of organizational staff capability, all sustainability determinants were unrelated to program adaptation as predicted.

conclusionsThe SMSS demonstrated good reliability and convergent and discriminant validity in assessing likelihood of sustainment of SAMHSA funded prevention programs and initiatives. The measure demonstrates potential in identifying predictors of program sustainment and as a tool for enhancing the likelihood of successful sustainment through ongoing evaluation and feedback.

Indexed as

Substance-Related DisordersUnited States Substance Abuse and Mental Health Services AdministrationFactor Analysis, StatisticalHumansProgram EvaluationReproducibility of ResultsUnited StatesBehavioral healthMeasurementPreventionSustainabilitySustainment

Identifiers

PMID32883352
PMCPMC7470441

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.