Evidence map›Paper›PMID 33706780›Full record

SynthesisImplementation science : IS2021

Cost analysis in implementation studies of evidence-based practices for mental health and substance use disorders: a systematic review.

Diana M Bowser, Brandy F Henry, Kathryn E McCollister

Open access · goldAbstract readSystematic Review
In one paragraph

Synthesis in Implementation science : IS, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 40 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
40citing papers in PubMed, 2 pooled it
12.2field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

40 citing papers in PubMed, 2 syntheses or guidelines pooled it, 57 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Characterizing Fidelity Monitoring Practices in Community Behavioral Health Care.The journal of behavioral health services & research · 2026
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 2 institutions in 1 country.

Diana M BowserHeller School for Social Policy and Management, Brandeis University, 415 South St, Waltham, MA, 02453, USA.
Brandy F HenryHeller School for Social Policy and Management, Brandeis University, 415 South St, Waltham, MA, 02453, USA. bh2756@columbia.edu.ORCID 0000-0002-0667-9283
Kathryn E McCollisterDepartment of Public Health Sciences, University of Miami Miller School of Medicine, 1120 NW 14th St., CRB 1019, Miami, FL, 33136, USA.
Brandeis University · USUniversity of Miami · US

Funding

Utilization of health services after engagement with opioid use disorder (OUD) treatment provider by individuals with and without post-traumatic stress disorderP30DA040500 · NIDA · WEILL MEDICAL COLL OF CORNELL UNIV · PI Yuhua Bao · 2015 to 2026
$20.7M
TRAINING PROGRAM IN HEALTH SERVICES RES. ON ALCOHOL-RELAT32AA007567 · NIAAA · BRANDEIS UNIVERSITY · PI SHARON REIF · 1994 to 2026
$9.7M
Training Program on HIV and Substance Use in the Criminal Justice SystemT32DA037801 · NIDA · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI Nabila El-Bassel, Lisa R Metsch · 2014 to 2026
$5.7M
Improving HIV Service Delivery for People who Inject Drugs in KazakhstanR01DA041063 · NIDA · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI EL-BASSEL, NABILA, GILBERT, LOUISA · 2015 to 2019
$4.7M
Economic Evaluation of Medication-Assisted Substance Abuse TreatmentR01DA035808 · NIDA · WEILL MEDICAL COLL OF CORNELL UNIV · PI SCHACKMAN, BRUCE R · 2014 to 2017
$1.6M
Organizational and Environmental Factors Influencing the Implementation of Evidence Based Practices in Juvenile Justice SettingsR21DA044378 · NIDA · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI BOWSER, DIANA, MCCOLLISTER, KATHRYN E · 2017 to 2018
$431k
NIAAA NIH HHS T32 AA007567NIDA NIH HHS P30 DA040500NIDA NIH HHS R01 DA035808NIDA NIH HHS R01DA035808NIDA NIH HHS R01 DA041063NIDA NIH HHS R21 DA044378NIDA NIH HHS T32 DA037801
6 · The paper itself

Abstract

backgroundThis study is a systematic literature review of cost analyses conducted within implementation studies on behavioral health services. Cost analysis of implementing evidence-based practices (EBP) has become important within implementation science and is critical for bridging the research to practice gap to improve access to quality healthcare services. Costing studies in this area are rare but necessary since cost can be a barrier to implementation and sustainment of EBP.

methodsWe followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology and applied the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist. Key search terms included: (1) economics, (2) implementation, (3) EBP, and (4) behavioral health. Terms were searched within article title and abstracts in: EconLit, SocINDEX, Medline, and PsychINFO. A total of 464 abstracts were screened independently by two authors and reduced to 37 articles using inclusion and exclusion criteria. After a full-text review, 18 articles were included.

resultsFindings were used to classify costs into direct implementation, direct services, and indirect implementation. While all studies included phases of implementation as part of their design, only five studies examined resources across multiple phases of an implementation framework. Most studies reported direct service costs associated with adopting a new practice, usually summarized as total EBP cost, cost per client, cost per clinician, and/or cost per agency. For studies with detailed analysis, there were eleven direct cost categories represented. For five studies that reported costs per child served, direct implementation costs varied from $886 to $9470 per child, while indirect implementation costs ranged from $897 to $3805 per child.

conclusionsThis is the first systematic literature review to examine costs of implementing EBP in behavioral healthcare settings. Since 2000, 18 studies were identified that included a cost analysis. Given a wide variation in the study designs and economic methods, comparison across studies was challenging, which is a major limitation in the field, as it becomes difficult to replicate studies or to estimate future costs to inform policy decisions related to budgeting. We recommend future economic implementation studies to consider standard economic costing methods capturing costs across implementation framework phases to support comparisons and replicability.

Indexed as

Mental HealthSubstance-Related DisordersChildCost-Benefit AnalysisDelivery of Health CareEvidence-Based PracticeHumansBehavioral healthCostsEconomicsEvidence-based practicesImplementation

Identifiers

PMID33706780
PMCPMC7953634
OpenAlexW3134013756

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.