Evidence map›Paper›PMID 34461948›Full record

ArticleImplementation science : IS2021

Provider REport of Sustainment Scale (PRESS): development and validation of a brief measure of inner context sustainment.

Joanna C Moullin, Marisa Sklar, Mark G Ehrhart, Amy Green, Gregory A Aarons

Abstract read
In one paragraph

Article in Implementation science : IS, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 49 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
49citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

49 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Joanna C MoullinFaculty of Health Sciences, Curtin Medical School, Curtin University, Kent Street, Bentley, Perth, Western Australia, 6102, Australia.
Marisa SklarChild and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, San Diego, CA, 92123, USA.
Mark G EhrhartDepartment of Psychology, University of Central Florida, PO Box 161390, Orlando, FL, 32816-1390, USA.
Amy GreenChild and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, San Diego, CA, 92123, USA.
Gregory A AaronsChild and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, San Diego, CA, 92123, USA. gaarons@health.ucsd.edu.ORCID 0000-0001-8969-5002

Funding

Mixed-Methods Study of EBP Sustainment in a Statewide Service SystemR01MH072961 · NIMH · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI AARONS, GREGORY · 2005 to 2016
$5.8M
Statewide System and Organizational Strategy for Evidence-Based Practice Implementation and Sustainment in Substance Use Disorder TreatmentR01DA049891 · NIDA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI AARONS, GREGORY · 2020 to 2024
$3.6M
1/2 Effectiveness of a Multi-Level Implementation Strategy for ASD Interventions - SupplementR01MH111950 · NIMH · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI BROOKMAN-FRAZEE, LAUREN · 2017 to 2020
$3.3M
Testing the Leadership and Organizational Change for Implementation (LOCI) Intervention in Substance Abuse Treatment ProgramsR01DA038466 · NIDA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI AARONS, GREGORY · 2015 to 2019
$3.0M
Development and Testing of an Evidence Based Intervention Sustainment MeasureR03MH117493 · NIMH · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI AARONS, GREGORY · 2018 to 2019
$157k
NIDA NIH HHS R01 DA038466NIDA NIH HHS R01 DA049891NIMH NIH HHS R01 MH072961NIMH NIH HHS R01 MH111950NIMH NIH HHS R03 MH117493
6 · The paper itself

Abstract

backgroundImplementation scientists and practitioners often rely on frontline providers for reporting on implementation outcomes. Furthermore, measures of sustainment are few, and available sustainment measures are mainly setting or evidenced-based practice (EBP) specific, require organizational and system-level knowledge to complete, and often lack psychometric rigor. The aim of this study was to develop a brief, pragmatic, and generalizable measure for completion by frontline service providers of the implementation outcome, sustainment.

methodsWe utilized a Rasch measurement theory approach to scale the development and testing of psychometric parameters. Sustainment items were developed to be relevant for direct service providers to complete. In order to promote generalizability, data were collected and items were tested across four diverse psychosocial evidence-based practices (motivational interviewing [MI], SafeCare®, classroom pivotal response training [CPRT], and an individualized mental health intervention for children with autism spectrum disorder [AIM-HI]) and in four service settings (substance use disorder treatment, child welfare, education, and specialty mental health). Associations between the sustainment measure and sustainment leadership, sustainment climate, and attitudes towards the adoption and use of each of the EBPs were assessed to confirm construct validity.

resultsThree items for the Provider REport of Sustainment Scale (PRESS) were assessed for measuring the core component of sustainment: continued use of the EBP. Internal consistency reliability was high. The scale indicated fit to the Rasch measurement model with no response dependency, ordered thresholds, no differential item functioning, and supported unidimensionality. Additionally, construct validity evidence was provided based on the correlations with related variables.

conclusionThe PRESS measure is a brief, three-item measure of sustainment that is both pragmatic and useable across different EBPs, provider types, and settings. The PRESS captures frontline staffs' report of their clinic, team, or agency's continued use of an EBP. Future testing of the PRESS for concurrent and predictive validity is recommended.

Indexed as

Autism Spectrum DisorderChildEvidence-Based PracticeHumansLeadershipPsychometricsReproducibility of ResultsImplementationKnowledge translationMaintenanceMeasurementPsychometric propertiesScaleSustainabilitySustainment

Identifiers

PMID34461948
PMCPMC8404332

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.