Evidence map›Paper›PMID 38070868›Full record

Trial reportJournal of the American Academy of Child and Adolescent Psychiatry2024

Randomized Trial of an Organizational Implementation Strategy to Improve Measurement-Based Care Fidelity and Youth Outcomes in Community Mental Health.

Nathaniel J Williams, Steven C Marcus, Mark G Ehrhart, Marisa Sklar, Susan M Esp, Kristine Carandang, Nallely Vega, Alexandra E Gomes, Lauren Brookman-Frazee, Gregory A Aarons

Registry-linked trialOpen access · bronzeAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of the American Academy of Child and Adolescent Psychiatry, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04096274 (Randomized Trial of a Leadership and Organizational Change Strategy to Improve the Implementation and Sustainment of Digital Measurement-based Care in Youth Mental Health Services), which is not on this map. Cited by 28 papers.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed
15.3field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04096274 nacompletednot on this map

Randomized Trial of a Leadership and Organizational Change Strategy to Improve the Implementation and Sustainment of Digital Measurement-based Care in Youth Mental Health Services

TypeinterventionalSponsorBoise State UniversityRan2019 to 2022Enrolled686ConditionsImplementation, Behavioral SymptomsArmsLeadership for Organization Change and Implementation (LOCI), Training and Technical Assistance Only
3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 35 citations in OpenAlex.

  1. Trial
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Observational
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 4 institutions in 1 country.

Nathaniel J WilliamsBoise State University, Boise, Idaho. Electronic address: natewilliams@boisestate.edu.
Steven C MarcusUniversity of Pennsylvania, Philadelphia, Pennsylvania.
Mark G EhrhartUniversity of Central Florida, Orange County, Florida.
Marisa SklarUniversity of California, San Diego, California.
Susan M EspBoise State University, Boise, Idaho.
Kristine CarandangUniversity of California, San Diego, California.
Nallely VegaBoise State University, Boise, Idaho.
Alexandra E GomesBoise State University, Boise, Idaho.
Lauren Brookman-FrazeeUniversity of California, San Diego, California.
Gregory A AaronsUniversity of California, San Diego, California.
Boise State University · USUniversity of California San Diego · USUniversity of Central Florida · USUniversity of Pennsylvania · US

Funding

Randomized trial of a leadership and organizational change strategy to improve the implementation and sustainment of digital measurement-based care in youth mental health servicesR01MH119127 · NIMH · BOISE STATE UNIVERSITY · PI WILLIAMS, NATHANIEL J. · 2019 to 2022
$2.8M
NIMH NIH HHS R01 MH119127
6 · The paper itself

Abstract

objectiveMeasurement-based care (MBC), which collects session-by-session symptom data from patients and provides clinicians with feedback on treatment response, is a highly generalizable evidence-based practice with significant potential to improve the outcomes of mental health treatment in youth when implemented with fidelity; however, it is rarely used in community settings. This study tested whether an implementation strategy targeting organizational leadership and organizational implementation climate could improve MBC fidelity and clinical outcomes for youth in outpatient mental health clinics.

methodIn a cluster randomized trial, 21 clinics were assigned to the Leadership and Organizational Change for Implementation strategy plus training and technical assistance in MBC (k = 11, n = 117) or training and technical assistance only (k = 10, n = 117). Primary outcomes of MBC fidelity (assessed via electronic metadata) and youth symptom improvement (assessed via caregiver-reported change on the Shortform Assessment for Children Total Problem Score) were collected for consecutively enrolled youths (ages 4-18 years) who initiated treatment in the 12 months following MBC training. Outcomes of each youth were assessed for 6 months following baseline.

resultsA total of 234 youths were enrolled and included in intent-to-treat analyses. At baseline, there were no significant differences by condition in clinic, clinician, or youth characteristics. Youths in clinics using the Leadership and Organizational Change for Implementation strategy experienced significantly higher MBC fidelity compared with youths in control clinics (23.1% vs 3.4%, p = .014), and exhibited significantly greater reductions in symptoms from baseline to 6 months (d = 0.31, 95% CI: 0.04-0.58, p = .023).

conclusionImplementation strategies targeting organizational leadership and focused implementation climate can improve fidelity to evidence-based practices and clinical outcomes of youth mental health services. PLAIN LANGUAGE SUMMARY: Measurement-based care is an evidence-based intervention that has been shown to improve the outcomes of mental health services in dozens of randomized trials; however, it is not widely used in routine practice. In this randomized controlled trial of 21 outpatient mental health clinics and 234 youth, the authors found an organizational intervention which trained clinic leaders in skills to support the use of measurement-based care increased the extent to which patients received measurement-based care compared to control clinics where clinic leaders did not receive this training (23% vs. 3%). Youth receiving services in the clinics that received the organizational intervention also had greater reductions in mental health symptoms. CLINICAL TRIAL REGISTRATION INFORMATION: Working to Implement and Sustain Digital Outcome Measures (WISDOM); https://clinicaltrials.gov/; NCT04096274.

Indexed as

Community Mental Health ServicesAdolescentChildChild, PreschoolEvidence-Based PracticeFemaleHumansLeadershipMaleMental DisordersimplementationleadershipLOCImeasurement-based careorganizational climate

Identifiers

PMID38070868
PMCPMC11265517
OpenAlexW4389410490

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.