Evidence map›Paper›PMID 35230600›Full record

Trial reportAdministration and policy in mental health2022

Performance of a Supervisor Observational Coding System and an Audit and Feedback Intervention.

Jason E Chapman, Sonja K Schoenwald, Ashli J Sheidow, Phillippe B Cunningham

Open access · greenAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Administration and policy in mental health, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed, 1 pooled it
0.3field-weighted citation impact, top 41% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 1 synthesis or guideline pooled it, 1 citations in OpenAlex.

  1. Pooled it
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 1 country.

Jason E ChapmanOregon Social Learning Center, Eugene, USA.ORCID 0000-0002-9396-5877
Sonja K SchoenwaldOregon Social Learning Center, Eugene, USA. sonja.schoenwald@oslc.org.ORCID 0000-0002-0560-8440
Ashli J SheidowOregon Social Learning Center, Eugene, USA.ORCID 0000-0002-0081-6179
Phillippe B CunninghamMedical University of South Carolina, Charleston, USA.
Oregon Social Learning Center · USMedical University of South Carolina · US

Funding

Measuring and Improving Supervisor Adherence and CompetenceR33MH097000 · NIMH · OREGON SOCIAL LEARNING CENTER, INC. · PI CHAPMAN, JASON E · 2014 to 2016
$775k
Measuring and Improving Supervisor Adherence and CompetenceR21MH097000 · NIMH · MEDICAL UNIVERSITY OF SOUTH CAROLINA · PI CHAPMAN, JASON E, SCHOENWALD, SONJA K. · 2012 to 2013
$388k
NIMH NIH HHS R21 MH097000NIMH NIH HHS R33 MH097000
6 · The paper itself

Abstract

Workplace-based clinical supervision is common in community based mental health care for youth and families and could be a leveraged to scale and improve the implementation of evidence-based treatment (EBTs). Accurate methods are needed to measure, monitor, and support supervisor performance with limited disruption to workflow. Audit and Feedback (A&F) interventions may offer some promise in this regard. The study-a randomized controlled trial with 60 clinical supervisors measured longitudinally for 7 months-had two parts: (1) psychometric evaluation of an observational coding system for measuring adherence and competence of EBT supervision and (2) evaluation of an experimental Supervisor Audit and Feedback (SAF) intervention on outcomes of supervisor adherence and competence. All supervisors recorded and uploaded weekly supervision sessions for 7 months, and those in the experimental condition were provided a single, monthly web-based feedback report. Psychometric performance was evaluated using measurement models based in Item Response Theory, and the effect of the SAF intervention was evaluated using mixed-effects regression models. The observational instrument performed well across psychometric indicators of dimensionality, rating scale functionality, and item fit; however, coder reliability was lower for competence than for adherence. Statistically significant A&F effects were largely in the expected directions and consistent with hypotheses. The observational coding system performed well, and a monthly electronic feedback report showed promise in maintaining or improving community-based clinical supervisors' adherence and, to a lesser extent, competence. Limitations discussed include unknown generalizability to the supervision of other EBTs.

Indexed as

WorkplaceAdolescentFeedbackHumansPsychometricsReproducibility of ResultsAudit and feedbackBehavioral healthClinical supervisionEvidence-based treatmentImplementationMental healthObservational measurement

Identifiers

PMID35230600
PMCPMC9246920
OpenAlexW4214666922

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.