ArticleBehaviour research and therapy2020
Use of role plays to assess therapist competency and its association with client outcomes in psychological interventions: A scoping review and competency research agenda.
Article in Behaviour research and therapy, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05290142 (A Pre-and-post Study With a Nested Randomised Controlled Trial of Coach Versus Self-guided Digital Training in a Youth-focused Problem-solving Intervention), which is not on this map. Cited by 24 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
A Pre-and-post Study With a Nested Randomised Controlled Trial of Coach Versus Self-guided Digital Training in a Youth-focused Problem-solving Intervention
Who cites it
24 citing papers in PubMed, 47 citations in OpenAlex.
- Improving Cardiometabolic Health in Adolescent Girls With Elevated Anxiety: Web-Based Multisite, Pilot, and Feasibility Randomized Controlled Trial.JMIR cardio · 2026Trial
- Evaluation of competency-driven training for facilitators delivering a psychological intervention for children in Lebanon: a proof-of-concept study.Epidemiology and psychiatric sciences · 2022Trial
- Predictors of caregiver support intervention outcomes for refugees in Jordan: a three-path mediational study.Child and adolescent psychiatry and mental health · 2025Article
- Competency-based training and supervision: development of the WHO-UNICEF Ensuring Quality in Psychosocial and Mental Health Care (EQUIP) initiative.The lancet. Psychiatry · 2025Article
- Piloting competency assessments for an evidence-based brief psychological intervention with Arabic-speaking non-specialists in Switzerland.Global mental health (Cambridge, England) · 2025Article
- Effects of deliberate practice and structured feedback in psychotherapy training (DeeP): a study protocol of a randomized-control-trial.BMC psychology · 2024Article
- Fine-tuning Postgraduate Psychiatry Training in South Asia.Indian journal of psychological medicine · 2024Article
- Article
- Beyond multiple choice: Clinical simulation as a rigorous and inclusive method for assessing genetic counseling competencies.Journal of genetic counseling · 2024Article
- Knowledge of Problem Solving (KOPS) Scale: Design and Evaluation of a Digitally Administered Competence Measure for a Common Practice Element in Task-Shared Youth Mental Health Interventions.Journal of technology in behavioral science · 2024Article
- Coach-Supported Versus Self-guided Digital Training Course for a Problem-solving Psychological Intervention for Nonspecialists: Protocol for a Pre-Post Nested Randomized Controlled Trial.JMIR research protocols · 2023Article
- Identifying Core Competencies for Remote Delivery of Psychological Interventions: A Rapid Review.Psychiatric services (Washington, D.C.) · 2023Review
- Adaptation and translation of a scalable measure for assessing health worker competence to deliver a brief psychological intervention: A case study from central India of its comparison to a performance-based measure.The Psychiatric quarterly · 2023Article
- Improving inter-rater reliability of the enhancing assessment of common therapeutic factors (ENACT) measure through training of raters.Journal of public health in Africa · 2022Article
- Measurement and assessment of fidelity and competence in nonspecialist-delivered, evidence-based behavioral and mental health interventions: A systematic review.SSM - population health · 2022Review
- ENhancing Assessment of Common Therapeutic factors (ENACT) tool: adaptation and psychometric properties in South Africa.Global mental health (Cambridge, England) · 2022Article
- The concise measurement of clinical communication skills: Validation of a short scale.Frontiers in psychiatry · 2022Article
- Competency-based pre-service education for clinical psychology training in low- and middle-income countries: Case study of Makerere University in Uganda.Frontiers in psychology · 2022Article
- Patient outcomes and experience of a task-shared screening and brief intervention service for problem substance use in South African emergency centres: a mixed methods study.Addiction science & clinical practice · 2021Article
- Process evaluation of TeamUp: a movement-based psychosocial intervention for refugee children in the Netherlands.International journal of mental health systems · 2021Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors at 2 institutions in 2 countries.
Funding
Abstract
A major challenge in scaling-up psychological interventions worldwide is how to evaluate competency among new workforces engaged in psychological services. One approach to measuring competency is through standardized role plays. Role plays have the benefits of standardization and reliance on observed behavior rather than written knowledge. However, role plays are also resource intensive and dependent upon inter-rater reliability. We undertook a two-part scoping review to describe how competency is conceptualized in studies evaluating the relationship of competency with client outcomes. We focused on use of role plays including achieving inter-rater reliability and the association with client outcomes. First, we identified 4 reviews encompassing 61 studies evaluating the association of competency with client outcomes. Second, we identified 39 competency evaluation tools, of which 21 were used in comparisons with client outcomes. Inter-rater reliability (intraclass correlation coefficient) was reported for 15 tools and ranged from 0.53 to 0.96 (mean ICC = 0.77). However, we found that none of the outcome comparison studies measured competency with standardized role plays. Instead, studies typically used therapy quality (i.e., session ratings with actual clients) as a proxy for competency. This reveals a gap in the evidence base for competency and its role in predicting client outcomes. We therefore propose a competency research agenda to develop an evidence-base for objective, standardized role plays to measure competency and its association with client outcomes. OPEN SCIENCE REGISTRATION #: https://osf.io/nqhu7/.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.