Evidence map›Paper›PMID 33509415›Full record

ArticleJournal of substance abuse treatment2021

Effectiveness of value-based purchasing for substance use treatment engagement and retention.

Sharon Reif, Maureen T Stewart, Maria E Torres, Margot T Davis, Beth Mohr Dana, Grant A Ritter

Open access · greenAbstract read
In one paragraph

Article in Journal of substance abuse treatment, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 2 pooled it
0.9field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 2 syntheses or guidelines pooled it, 6 citations in OpenAlex.

  1. Substance Use Disorder Treatment Outcomes: Methodological Overview of Metrics and Criteria.International journal of methods in psychiatric research · 2025
    Pooled it
  2. Pooled it
  3. Article
  4. Review
  5. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 1 institution in 1 country.

Sharon ReifInstitute for Behavioral Health, Heller School for Social Policy and Management, Brandeis University, 415 South Street, Waltham, MA 02453, United States of America. Electronic address: reif@brandeis.edu.
Maureen T StewartInstitute for Behavioral Health, Heller School for Social Policy and Management, Brandeis University, 415 South Street, Waltham, MA 02453, United States of America.
Maria E TorresInstitute for Behavioral Health, Heller School for Social Policy and Management, Brandeis University, 415 South Street, Waltham, MA 02453, United States of America.
Margot T DavisInstitute for Behavioral Health, Heller School for Social Policy and Management, Brandeis University, 415 South Street, Waltham, MA 02453, United States of America.
Beth Mohr DanaInstitute for Behavioral Health, Heller School for Social Policy and Management, Brandeis University, 415 South Street, Waltham, MA 02453, United States of America.
Grant A RitterInstitute for Behavioral Health, Heller School for Social Policy and Management, Brandeis University, 415 South Street, Waltham, MA 02453, United States of America.
Brandeis University · US

Funding

Research Support CoreP30DA035772 · NIDA · BRANDEIS UNIVERSITY · PI Haiden A Huskamp, SHARON REIF · 2015 to 2026
$11.3M
Incentives in Public Addiction Treatment: Testing Design and Enhancing ImpactR01DA033402 · NIDA · BRANDEIS UNIVERSITY · PI REIF, SHARON · 2012 to 2016
$2.2M
NIDA NIH HHS P30 DA035772NIDA NIH HHS R01 DA033402
6 · The paper itself

Abstract

introductionMany people drop out of substance use disorder (SUD) treatment within the first few sessions, which suggests the need for innovative strategies to address this. We examined the effectiveness of incentive-based contracting for Maine's publicly funded outpatient (OP) and intensive outpatient (IOP) SUD treatment, to determine its potential for improving treatment engagement and retention.

methodsMaine's incentive-based contract with federally block grant-funded OP and IOP treatment agencies created a natural experiment, in which we could compare treatment engagement and retention with a group of state-licensed treatment agencies that were not part of the incentive-based contract. We used administrative data for OP (N = 18,375) and IOP (N = 5986) SUD treatment admissions from FY2005-FY2011 to capture trends prior to and after the FY2008 contract implementation date. We performed multivariable difference-in-difference logistic regression models following propensity score matching of clients.

resultsTwo-thirds (66%) of OP admissions engaged in treatment, defined as 4+ treatment sessions, and 85% of IOP admissions satisfied the similar criteria of 4+ treatment days. About 40-45% of OP admissions reached the threshold for retention, defined as 90 days in treatment. IOP treatment completion was attained by 50-58% of admissions. For OP, the incentive and nonincentive groups had no significant differences in percentages with treatment engagement (AOR = 1.28, DID = 5.9%, p = .19), and 90-day retention was significant in the opposite direction of what we hypothesized (AOR = 0.80, DID = -4.6%, p = .0003). For IOP, the incentive group had a significant, but still small, increase in percentage with treatment engagement (AOR = 1.52, DID = 5.5%, p = .003), but the corresponding increase in treatment completion was not similarly significant (AOR = 1.12, DID = 2.7%, p = .53). In all models, individual-level variables were strong predictors of outcomes.

conclusionWe found little to no impact of the incentive-based contract on the treatment engagement, retention, and completion measures, adding to the body of evidence that shows few or null results for value-based purchasing in SUD treatment programs. The limited success of such efforts is likely to reflect the bandwidth that providers and programs have to focus on new endeavors, the importance of the incentive funding to their bottom line, and forces beyond their immediate control.

Indexed as

Substance-Related DisordersValue-Based PurchasingAmbulatory CareHumansMotivationOutpatientsIncentivesSubstance use disorderTreatmentTreatment engagementTreatment retentionValue-based purchasing

Identifiers

PMID33509415
PMCPMC8380407
OpenAlexW3108953659

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.