Trial report in Psychiatric services (Washington, D.C.), 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.
0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
2 · The registry
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
5 · Who and what money
Authors and funding
9 authors.
Nathaniel J WilliamsSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0000-0002-3948-7480
Gregory A AaronsSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0000-0001-8969-5002
Mark G EhrhartSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0000-0003-2593-809X
Susan EspSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0009-0002-8045-1540
Nallely VegaSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0009-0002-4502-4340
Marisa SklarSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0000-0002-1263-6132
Kristine CarandangSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0000-0002-0159-6374
Lauren Brookman-FrazeeSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0000-0001-7582-7529
Steven C MarcusSchool of Social Work, Boise State University, Boise, Idaho (Williams, Esp); Department of Psychiatry, University of California, San Diego School of Medicine, La Jolla (Aarons, Sklar, Carandang, Brookman-Frazee); Department of Psychology, University of Central Florida, Orlando (Ehrhart); Ballmer Institute for Children's Behavioral Health, University of Oregon, Portland (Vega); School of Social Policy and Practice, University of Pennsylvania, Philadelphia (Marcus).ORCID 0000-0001-7819-3824
Funding
Randomized trial of a leadership and organizational change strategy to improve the implementation and sustainment of digital measurement-based care in youth mental health servicesR01MH119127 · NIMH · BOISE STATE UNIVERSITY · PI WILLIAMS, NATHANIEL J. · 2019 to 2022
$2.8M
NIMH NIH HHS R01 MH119127
6 · The paper itself
Abstract
objectiveLittle is known about how to sustain evidence-based interventions with fidelity in community mental health settings. Phase 1 of the Working to Implement and Sustain Digital Outcome Measures (WISDOM) trial showed that an organizational strategy improved the implementation of measurement-based care (MBC) in mental health services for youths 1-12 months after clinician MBC training. The authors report results from phase 2 of the trial, in which the strategy's effects on MBC sustainment 13-26 months after clinician MBC training were examined.
methodsTwenty-one outpatient mental health clinics were randomly assigned to MBC training and technical assistance plus the Leadership and Organizational Change for Implementation (LOCI) strategy (11 clinics) or to training and technical assistance only (10 clinics). In phase 2, the primary outcomes of MBC completion rate, youth symptom improvement, and MBC fidelity were examined for 452 youths who entered treatment 13-26 months after clinician MBC training.
resultsNo differences were found in MBC completion rate or symptom improvement between the two conditions; however, among the 81 youths who received MBC, fidelity was significantly higher at LOCI sites relative to control sites (24%, SE=11.1 vs. 1%, SE=1.0, respectively; p=0.003).
conclusionsDuring phase 2, LOCI sites (vs. control sites) sustained superior MBC fidelity when MBC was used; however, superior MBC completion rates and clinical outcomes were not sustained. Sustainment of MBC may require strategies that improve its fit with regulatory and reimbursement environments in addition to strategies that develop clinic infrastructure.
Indexed as
Community Mental Health ServicesMental DisordersOutcome Assessment, Health CareAdolescentFemaleHumansMaleOrganizational Innovationcommunity mental health servicesevidence-based practiceimplementationLOCImeasurement-based careorganizational climate
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.
Effects of an Organizational Implementation Strategy on Sustainment of Measurement-Based Care in Community Mental Health. · full record | OpenQuestion