Evidence map›Paper›PMID 26301424›Full record

ArticlePsychotherapy (Chicago, Ill.)2015

Removing very low-performing therapists: A simulation of performance-based retention in psychotherapy.

Zac E Imel, Elisa Sheng, Scott A Baldwin, David C Atkins

Abstract read
In one paragraph

Article in Psychotherapy (Chicago, Ill.), 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Machine-Learning-Based Prediction of Client Distress From Session Recordings.Clinical psychological science : a journal of the Association for Psychological Science · 2024
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Technology-enhanced human interaction in psychotherapy.Journal of counseling psychology · 2017
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Zac E ImelDepartment of Educational Psychology.
Elisa ShengDepartment of Biostatistics, University of Washington.
Scott A BaldwinDepartment of Psychology, Brigham Young University.
David C AtkinsDepartment of Psychiatry and Behavioral Sciences, University of Washington.

Funding

Implementation of Technology-Based Evaluation of Motivational InterviewingR01AA018673 · NIAAA · UNIVERSITY OF WASHINGTON · PI ATKINS, DAVID CHARLES, NARAYANAN, SHRIKANTH · 2010 to 2020
$5.9M
Development and feasibility of computer based fidelity monitoring for MIR34DA034860 · NIDA · UNIVERSITY OF UTAH · PI IMEL, ZACHARY E. · 2013 to 2015
$739k
NIAAA NIH HHS R01 AA018673NIAAA NIH HHS R01/AA018673NIDA NIH HHS R34 DA034860NIDA NIH HHS R34/DA034860
6 · The paper itself

Abstract

Therapists can impact the likelihood a given patient will benefit from psychotherapy. However, therapists are rarely held accountable for their patients' outcomes. As a result, low-performing providers likely continue to practice alongside providers with high response rates. In the current study, we conducted a Monte Carlo simulation to illustrate a thought experiment-what happens to patient outcomes if therapists with the worst outcomes were removed from practice? We drew initial samples of 50 therapists from 3 simulated populations of 1,000 therapists with a mean patient response rate of 50% and different effect sizes for therapist variability in outcomes. We simulated 30 patient outcomes for each therapist, with outcome defined as response to treatment versus no response. We removed therapists with response rates in the bottom 5% and replaced them with a random sample of therapists from the population. Over 10 years, the difference in responses between the lowest and highest performing therapists was substantial (between 697 and 997 additional responses to treatment). After repeatedly removing the lowest performing providers 40 times (simulating a 10-year time span), response rates increased substantially. The cumulative number of patient responses (i.e., summing the total number of responses across 10 years) increased by 4,266, 6,404, and 9,307 when therapists accounted for 5%, 10%, or 20% of the patient outcome variance, respectively. These findings indicate that performance-based retention of therapists could improve the quality of psychotherapy in health systems by improving the average response rate and decreasing the probability that a patient will be treated by a therapist who consistently has poor outcomes.

Indexed as

Professional-Patient RelationsClinical CompetenceHealth PersonnelHumansMental DisordersMonte Carlo MethodPatient SatisfactionPsychotherapyTreatment Outcome

Identifiers

PMID26301424
PMCPMC5032628

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.