Evidence map›Paper›PMID 33541301›Full record

ArticleBMC psychiatry2021

Community stakeholder preferences for evidence-based practice implementation strategies in behavioral health: a best-worst scaling choice experiment.

Nathaniel J Williams, Molly Candon, Rebecca E Stewart, Y Vivian Byeon, Meenakshi Bewtra, Alison M Buttenheim, Kelly Zentgraf, Carrie Comeau, Sonsunmolu Shoyinka, Rinad S Beidas

Open access · goldAbstract read
In one paragraph

Article in BMC psychiatry, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
2.3field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 15 citations in OpenAlex.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 3 institutions in 1 country.

Nathaniel J WilliamsSchool of Social Work, Boise State University, Boise, ID, USA.
Molly CandonDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Rebecca E StewartDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Y Vivian ByeonDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Meenakshi BewtraCenter for Clinical Epidemiology and Biostatistics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Alison M ButtenheimLeonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA.
Kelly ZentgrafDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
Carrie ComeauDepartment of Behavioral Health and Intellectual disAbility Services (DBHIDS), Philadelphia, PA, USA.
Sonsunmolu ShoyinkaDepartment of Behavioral Health and Intellectual disAbility Services (DBHIDS), Philadelphia, PA, USA.
Rinad S BeidasDepartment of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA. rbeidas@upenn.edu.
University of Pennsylvania · USBoise State University · USUniversity of California, Los Angeles · US

Funding

Transforming mental health delivery through behavioral economics and implementation scienceP50MH113840 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI BEIDAS, RINAD SARY, BUTTENHEIM, ALISON MEREDITH · 2017 to 2020
$6.6M
NIMH NIH HHS P50 MH113840
6 · The paper itself

Abstract

backgroundCommunity behavioral health clinicians, supervisors, and administrators play an essential role in implementing new psychosocial evidence-based practices (EBP) for patients receiving psychiatric care; however, little is known about these stakeholders' values and preferences for implementation strategies that support EBP use, nor how best to elicit, quantify, or segment their preferences. This study sought to quantify these stakeholders' preferences for implementation strategies and to identify segments of stakeholders with distinct preferences using a rigorous choice experiment method called best-worst scaling.

methodsA total of 240 clinicians, 74 clinical supervisors, and 29 administrators employed within clinics delivering publicly-funded behavioral health services in a large metropolitan behavioral health system participated in a best-worst scaling choice experiment. Participants evaluated 14 implementation strategies developed through extensive elicitation and pilot work within the target system. Preference weights were generated for each strategy using hierarchical Bayesian estimation. Latent class analysis identified segments of stakeholders with unique preference profiles.

resultsOn average, stakeholders preferred two strategies significantly more than all others-compensation for use of EBP per session and compensation for preparation time to use the EBP (P < .05); two strategies were preferred significantly less than all others-performance feedback via email and performance feedback via leaderboard (P < .05). However, latent class analysis identified four distinct segments of stakeholders with unique preferences: Segment 1 (n = 121, 35%) strongly preferred financial incentives over all other approaches and included more administrators; Segment 2 (n = 80, 23%) preferred technology-based strategies and was younger, on average; Segment 3 (n = 52, 15%) preferred an improved waiting room to enhance client readiness, strongly disliked any type of clinical consultation, and had the lowest participation in local EBP training initiatives; Segment 4 (n = 90, 26%) strongly preferred clinical consultation strategies and included more clinicians in substance use clinics.

conclusionsThe presence of four heterogeneous subpopulations within this large group of clinicians, supervisors, and administrators suggests optimal implementation may be achieved through targeted strategies derived via elicitation of stakeholder preferences. Best-worst scaling is a feasible and rigorous method for eliciting stakeholders' implementation preferences and identifying subpopulations with unique preferences in behavioral health settings.

Indexed as

Evidence-Based PracticeHealth ServicesAdministrative PersonnelBayes TheoremHumansResearch DesignEvidence-based practiceImplementationParticipatory designStakeholder preferences

Identifiers

PMID33541301
PMCPMC7863375
OpenAlexW3126151733

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.