Evidence map›Paper›PMID 32507982›Full record

ArticleAdministration and policy in mental health2021

Therapist-Observer Concordance in Ratings of EBP Strategy Delivery: Challenges and Targeted Directions in Pursuing Pragmatic Measurement in Children's Mental Health Services.

Lauren Brookman-Frazee, Nicole A Stadnick, Teresa Lind, Scott Roesch, Laura Terrones, Miya L Barnett, Jennifer Regan, Catherine A Kennedy, Ann F Garland, Anna S Lau

Open access · greenAbstract read
In one paragraph

Article in Administration and policy in mental health, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed, 1 pooled it
11.9field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 1 synthesis or guideline pooled it, 34 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Training Community Therapists in Core Elements of CBT and Family Therapy for Adolescent Externalizing Problems.Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53
    Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Therapist Anxious Distress and Avoidance of Implementing Time-Out.Child psychiatry and human development · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Evidence-based practice in child and adolescent mental health · 2024
    Article
  16. Article
  17. Observed Engagement in Community Implemented Evidence-Based Practices for Children and Adolescents: Implications for Practice Delivery.Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53 · 2023
    Observational
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 7 institutions in 1 country.

Lauren Brookman-FrazeeDepartment of Psychiatry, University of California San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA.
Nicole A StadnickDepartment of Psychiatry, University of California San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA. nstadnic@health.ucsd.edu.ORCID 0000-0001-6520-2920
Teresa LindDepartment of Psychiatry, University of California San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA.
Scott RoeschDepartment of Psychology, San Diego State University, San Diego, CA, USA.
Laura TerronesDepartment of Psychiatry, University of California San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA.
Miya L BarnettDepartment of Counseling, Clinical, and School Psychology, University of California, Santa Barbara, Santa Barbara, CA, USA.
Jennifer ReganLos Angeles County Department of Mental Health, Los Angeles, CA, USA.
Catherine A KennedyDepartment of Psychiatry, University of California San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA.
Ann F GarlandDepartment of Counseling & Marital and Family Therapy, University of San Diego, San Diego, CA, USA.
Anna S LauDepartment of Psychology, University of California, Los Angeles, Los Angeles, CA, USA.
University of California San Diego · USLos Angeles County Department of Mental Health · USSan Diego State University · USUC San Diego Health System · USUniversity of California, Los Angeles · USUniversity of California, Santa Barbara · USUniversity of San Diego · US

Funding

Sustainment of Multiple EBP's Fiscally Mandate in Children's MH ServicesR01MH100134 · NIMH · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI BROOKMAN-FRAZEE, LAUREN, LAU, ANNA SHAN-LAI · 2014 to 2018
$3.9M
IMPLEMENTATION RESEARCH INSTITUTE FOR MENTAL HEALTH SERVICES IRI-MHSR25MH080916 · NIMH · WASHINGTON UNIVERSITY · PI Byron James Powell · 2009 to 2026
$3.7M
Identifying Quality Indicators within Multiple EBP Delivery in Child Mental Health ServicesR01MH112536 · NIMH · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI BROOKMAN-FRAZEE, LAUREN, LAU, ANNA SHAN-LAI · 2017 to 2020
$3.4M
Adapting and Implementing an Integrated Care Model for Youth with Autism Spectrum Disorder and Psychiatric ComorbidityK23MH110602 · NIMH · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI STADNICK, NICOLE A · 2017 to 2020
$813k
Lay Health Worker Mobilization to Address Disparities in Parent Training ServicesK01MH110608 · NIMH · UNIVERSITY OF CALIFORNIA SANTA BARBARA · PI BARNETT, MIYA · 2017 to 2020
$600k
NIMH NIH HHS K01 MH110608NIMH NIH HHS K23 MH110602NIMH NIH HHS R01 MH100134NIMH NIH HHS R01 MH112536NIMH NIH HHS R25 MH080916
6 · The paper itself

Abstract

Pragmatic measures of therapist delivery of evidence-based practice (EBP) are critical to assessing the impact of large-scale, multiple EBP implementation efforts. As an initial step in the development of pragmatic measurement, the current study examined the concordance between therapist and observer ratings of items assessing delivery of EBP strategies considered essential for common child EBP targets. Possible EBP-, session-, and therapist-levels factors associated with concordance were also explored. Therapists and independent observers rated the extensiveness of therapist (n = 103) EBP strategy delivery in 680 community psychotherapy sessions in which six EBPs were used. Concordance between therapist- and observer-report of the extensiveness of therapist EBP strategy use was at least fair (ICC ≥ .40) for approximately half of the items. Greater therapist-observer concordance was observed in sessions where a structured EBP was delivered and in sessions where therapists reported being able to carry out planned activities. Findings highlighted conditions that may improve or hinder therapists' ability to report on their own EBP strategy delivery in a way that is consistent with independent observers. These results can help inform the development of pragmatic therapist-report measures of EBP strategy delivery and implementation efforts more broadly.

Indexed as

Attitude of Health PersonnelMental Health ServicesChildEvidence-Based PracticeHumansPsychotherapyCommunity mental healthEvidence-based practice implementationPragmatic measures

Identifiers

PMID32507982
PMCPMC7722101
OpenAlexW3033969809

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.