Evidence map›Paper›PMID 29973280›Full record

Trial reportImplementation science : IS2018

Pay-for-performance as a cost-effective implementation strategy: results from a cluster randomized trial.

Bryan R Garner, Aung K Lwin, Gail K Strickler, Brooke D Hunter, Donald S Shepard

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Implementation science : IS, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT01016704 (Reinforcing Therapist Performance), which is not on this map. Cited by 19 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT01016704 nacompletednot on this map

Reinforcing Therapist Performance

TypeinterventionalSponsorChestnut Health SystemsRan2008 to 2011Enrolled105ConditionsSubstance UseArmsIncentive
3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Bryan R GarnerRTI International, P. O. Box 12194, Research Triangle Park, Raleigh, NC, 27709-2194, USA. bgarner@rti.org.ORCID 0000-0002-7856-9403
Aung K LwinSchneider Institutes for Health Policy, The Heller School, MS035, Brandeis University, Waltham, MA, USA.
Gail K StricklerSchneider Institutes for Health Policy, The Heller School, MS035, Brandeis University, Waltham, MA, USA.
Brooke D HunterMinnesota Department of Human Services, Saint Paul, MN, USA.
Donald S ShepardSchneider Institutes for Health Policy, The Heller School, MS035, Brandeis University, Waltham, MA, USA.

Funding

Reinforcing Therapist PerformanceR01AA017625 · NIAAA · CHESTNUT HEALTH SYSTEMS, INC. · PI GARNER, BRYAN R · 2008 to 2010
$1.3M
National Institute on Drug Abuse (US) R01-AA017625NIAAA NIH HHS R01 AA017625
6 · The paper itself

Abstract

backgroundPay-for-performance (P4P) has been recommended as a promising strategy to improve implementation of high-quality care. This study examined the incremental cost-effectiveness of a P4P strategy found to be highly effective in improving the implementation and effectiveness of the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based treatment (EBT) for adolescent substance use disorders (SUDs).

methodsBuilding on a $30 million national initiative to implement A-CRA in SUD treatment settings, urn randomization was used to assign 29 organizations and their 105 therapists and 1173 patients to one of two conditions (implementation-as-usual (IAU) control condition or IAU+P4P experimental condition). It was not possible to blind organizations, therapists, or all research staff to condition assignment. All treatment organizations and their therapists received a multifaceted implementation strategy. In addition to those IAU strategies, therapists in the IAU+P4P condition received US $50 for each month that they demonstrated competence in treatment delivery (A-CRA competence) and US $200 for each patient who received a specified number of treatment procedures and sessions found to be associated with significantly improved patient outcomes (target A-CRA). Incremental cost-effectiveness ratios (ICERs), which represent the difference between the two conditions in average cost per treatment organization divided by the corresponding average difference in effectiveness per organization, and quality-adjusted life years (QALYs) were the primary outcomes.

resultsAt trial completion, 15 organizations were randomized to the IAU condition and 14 organizations were randomized to the IAU+P4P condition. Data from all 29 organizations were analyzed. Cluster-level analyses suggested the P4P strategy led to significantly higher average total costs compared to the IAU control condition, yet this average increase of 5% resulted in a 116% increase in the average number of months therapists demonstrated competence in treatment delivery (ICER = $333), a 325% increase in the average number of patients who received the targeted dosage of treatment (ICER = $453), and a 325% increase in the number of days of abstinence per patient in treatment (ICER = $8.134). Further supporting P4P as a cost-effective implementation strategy, the cost per QALY was only $8681 (95% confidence interval $1191-$16,171).

conclusionThis study provides experimental evidence supporting P4P as a cost-effective implementation strategy.

trial registrationNCT01016704 .

Indexed as

Evidence-Based MedicineReimbursement, IncentiveAdolescentAdolescent Health ServicesCommunity Mental Health ServicesCost-Benefit AnalysisFemaleHumansMaleQuality-Adjusted Life YearsQuality of Health CareSubstance-Related DisordersTreatment OutcomeAdolescentCost-effectivenessImplementation researchSubstance use

Identifiers

PMID29973280
PMCPMC6033288

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.