Evidence map›Paper›PMID 24711046›Full record

Trial reportAdministration and policy in mental health2015

Validity of therapist self-report ratings of fidelity to evidence-based practices for adolescent behavior problems: correspondence between therapists and observers.

Aaron Hogue, Sarah Dauber, Emily Lichvar, Molly Bobek, Craig E Henderson

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in Administration and policy in mental health, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 69 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
69citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

69 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Randomized Trial of Family Therapy Versus Nonfamily Treatment for Adolescent Behavior Problems in Usual Care.Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53 · 2015
    Trial
  13. Training Community Therapists in Core Elements of CBT and Family Therapy for Adolescent Externalizing Problems.Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53
    Trial
  14. Linking Adherence to Effectiveness in Family-Based Adolescent ADHD Academic Training and Medication Decision-Making Protocols.Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53
    Trial
  15. Randomized Trial of Academic Training and Medication Decision-Making for Adolescents with ADHD in Usual Care.Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53
    Trial
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

9 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Aaron HogueTreatment Research Division, The National Center on Addiction and Substance Abuse at Columbia University, 633 Third Avenue, 19th floor, New York, NY, 10017, USA, athogue@aol.com.
Sarah Dauber
Emily Lichvar
Molly Bobek
Craig E Henderson

Funding

Evidence-Based Practices and Service Outcomes in Usual Care for ASAR01DA023945 · NIDA · PARTNERSHIP TO END ADDICTION · PI DAUBER, SARAH E., HOGUE, AARON · 2009 to 2011
$775k
NIDA NIH HHS R01 DA023945NIDA NIH HHS R01DA023945
6 · The paper itself

Abstract

Developing therapist-report fidelity tools to support quality delivery of evidence-based practices in usual care is a top priority for implementation science. This study tested the reliability and accuracy of two groups of community therapists who reported on their use of family therapy (FT) and motivational interviewing/cognitive-behavioral therapy (MI/CBT) interventions during routine treatment of inner-city adolescents with conduct and substance use problems. Study cases (n = 45) were randomized into two conditions: (a) Routine Family Therapy (RFT), consisting of a single site that featured family therapy as its standard of care for behavioral treatment; or (b) Treatment As Usual (TAU), consisting of five sites that featured non-family approaches. Therapists and trained observational raters provided FT and MI/CBT adherence ratings on 157 sessions (104 RFT, 53 TAU). Overall therapist reliability was adequate for averaged FT ratings (ICC = .66) but almost non-existent for MI/CBT (ICC = .06); moreover, both RFT and TAU therapists were more reliable in reporting on FT than on MI/CBT. Both groups of therapists overestimated the extent to which they implemented FT and MI/CBT interventions. Results offer support for the feasibility of using existing therapist-report methods to anchor quality assurance procedures for FT interventions in real-world settings, though not for MI/CBT.

Indexed as

PsychotherapySelf ReportAdolescentAnxiety DisordersAttention Deficit and Disruptive Behavior DisordersAttention Deficit Disorder with HyperactivityClinical ProtocolsCognitive Behavioral TherapyConduct DisorderEvidence-Based PracticeFamily TherapyFemaleGuideline AdherenceHumansMaleMotivational Interviewing

Identifiers

PMID24711046
PMCPMC4763603

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.