Evidence map›Paper›PMID 40015542›Full record

ArticleAnnals of epidemiology2025

A framework for designing hybrid effectiveness-implementation trials for digital health interventions.

Theresa E Matson, Eric D A Hermes, Aaron R Lyon, Andrew Quanbeck, Stephen M Schueller, Sarah M Wilson, Joseph E Glass

Abstract read
In one paragraph

Article in Annals of epidemiology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. Article
  5. Review
  6. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Theresa E MatsonKaiser Permanente Washington Health Research Institute, Seatle, WA, United States. Electronic address: tessa.e.matson@kp.org.
Eric D A HermesVA Connecticut Healthcare System, West Haven, CT, United States; Yale University School of Medicine, New Haven, CT, United States.
Aaron R LyonDepartment of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States.
Andrew QuanbeckDepartment of Family Medicine & Community Health, University of Wisconsin-Madison, Madison, WI, United States.
Stephen M SchuellerDepartment of Psychological Science, University of California-Irvine, Irvine, CA, United States.
Sarah M WilsonCenter of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, United States; Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine, Durham, NC, United States.
Joseph E GlassKaiser Permanente Washington Health Research Institute, Seatle, WA, United States; Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States.

Funding

UW ALACRITY Center for Psychosocial Interventions ResearchP50MH115837 · NIMH · UNIVERSITY OF WASHINGTON · PI Michael David Pullmann · 2018 to 2026
$18.2M
Transforming health equity rhetoric to rigor: Development and validation of a novel measure assessing health equity in implementation of health interventionsP50DA054072 · NIDA · STANFORD UNIVERSITY · PI Mark P McGovern · 2022 to 2026
$18.1M
SUPERA: Supporting Peer Interactions to Expand Access to Digital Cognitive Behavioral Therapy for Spanish-speaking Safety-Net Patients in Primary CareR01MH126664 · NIMH · UNIVERSITY OF CALIFORNIA-IRVINE · PI Adrian Aguilera, Stephen Schueller · 2022 to 2026
$4.7M
Digital treatments for opioids and other substance use disorders (DIGITS) in primary care: Observational Analysis of Adaptions to the InterventionR01DA047954 · NIDA · KAISER FOUNDATION RESEARCH INSTITUTE · PI GLASS, JOSEPH EDWIN · 2019 to 2023
$3.9M
IMPLEMENTATION RESEARCH INSTITUTE FOR MENTAL HEALTH SERVICES IRI-MHSR25MH080916 · NIMH · WASHINGTON UNIVERSITY · PI Byron James Powell · 2009 to 2026
$3.7M
Promoting the implementation of clinical guidelines for opioid prescribing in primary care using systems consultationR01DA047279 · NIDA · UNIVERSITY OF WISCONSIN-MADISON · PI QUANBECK, ANDREW · 2018 to 2022
$3.5M
Integrating mHealth for Alcohol Use Disorders into Clinical PracticeR01AA024150 · NIAAA · UNIVERSITY OF WISCONSIN-MADISON · PI QUANBECK, ANDREW · 2018 to 2022
$3.3M
Clinic-level implementation of mHealth to improve HIV viral suppression for patients with substance use disordersR01DA055527 · NIDA · UNIVERSITY OF WISCONSIN-MADISON · PI Andrew Quanbeck, Ryan Patrick Westergaard · 2022 to 2026
$3.2M
Decreasing the Engagement Gap for Addiction Treatment in Primary CareK01AA023859 · NIAAA · KAISER FOUNDATION RESEARCH INSTITUTE · PI GLASS, JOSEPH EDWIN · 2017 to 2021
$931k
Conceptualizing the problem of implementation: a systems engineering perspective applied in substance abuse treatmentK01DA039336 · NIDA · UNIVERSITY OF WISCONSIN-MADISON · PI QUANBECK, ANDREW · 2015 to 2019
$741k
Physician coaching to reduce opioid-related harmsR34DA036720 · NIDA · UNIVERSITY OF WISCONSIN-MADISON · PI BROWN, RANDALL T, QUANBECK, ANDREW · 2014 to 2016
$683k
HSRD VA I01 HX003366HSRD VA IK2 HX002398NIAAA NIH HHS K01 AA023859NIAAA NIH HHS R01 AA024150NIDA NIH HHS K01 DA039336NIDA NIH HHS P50 DA054072NIDA NIH HHS R01 DA047279NIDA NIH HHS R01 DA047954NIDA NIH HHS R01 DA055527NIDA NIH HHS R34 DA036720NIMH NIH HHS P50 MH115837NIMH NIH HHS R01 MH126664NIMH NIH HHS R25 MH080916
6 · The paper itself

Abstract

This article proposes methods for designing randomized controlled trials studying the implementation and effectiveness of digital interventions, meaning websites or applications ("apps") that patients use in healthcare. Deploying digital interventions for behavioral health differs from implementing traditional interventions such as medications or human-delivered therapy. Prior trial design guidance has ignored the existence of international governmental evidence standards, has paid insufficient attention to implementation reporting guidelines, and has not described methods for empirically testing the approach for organizing the delivery of digital interventions. This framework for designing hybrid effectiveness-implementation trials of digital behavioral health interventions helps researchers articulate research questions that matter to decision-makers and meaningfully contribute to implementation. The framework outlines three phases: 1) frame effectiveness and implementation questions in terms of the digital intervention components, types of clinical support for the digital intervention, and specific strategies for implementing the digital intervention; 2) define and delineate actors, activities, action targets, dose, temporality, and outcomes to maximize inference and reproducibility; and 3) specify trial design features used for hybrid classification. We illustrate the utility of this framework with two effectiveness-implementation studies of digital interventions for substance use. This framework can help researchers decide on appropriate methodology and help decision-makers apply findings.

Indexed as

Randomized Controlled Trials as TopicResearch DesignDigital HealthHumansClinical trialsDigital interventionsImplementation scienceMethodsmHealth

Identifiers

PMID40015542
PMCPMC11972896

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.