Evidence map›Paper›PMID 39994781›Full record

ArticleImplementation science : IS2025

Rollout trial designs in implementation research are often necessary and sometimes preferred.

Gregory E Simon, Bryan R Garner, Justin D Smith, Peter A Wyman, Theresa E Matson, Lia Chin-Purcell, Ian Cero, Wouter Vermeer, Kimberly A Johnson, Guillermo Prado and 1 more

Abstract read
In one paragraph

Article in Implementation science : IS, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Cluster-Randomized Trials in Emergency Care Research.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2026
    Review
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Gregory E SimonKaiser Permanente Washington Health Research Institute, 1730 Minor Ave. #1360, Seattle, WA, 98101, USA. gregory.e.simon@kp.org.
Bryan R GarnerThe Ohio State University College of Medicine, Columbus, OH, USA.
Justin D SmithSpencer Fox Eccles School of Medicine, University of Utah, Salt Lake City, UT, USA.
Peter A WymanSchool of Medicine and Dentistry, University of Rochester, Rochester, NY, USA.
Theresa E MatsonKaiser Permanente Washington Health Research Institute, 1730 Minor Ave. #1360, Seattle, WA, 98101, USA.
Lia Chin-PurcellStanford University School of Medicine, Palo Alto, CA, USA.
Ian CeroSchool of Medicine and Dentistry, University of Rochester, Rochester, NY, USA.
Wouter VermeerFeinberg School of Medicine Northwestern University, Chicago, IL, USA.
Kimberly A JohnsonDepartment of Mental Health Law and Policy, University of South Florida, Tampa, FL, USA.
Guillermo PradoUniversity of Miami, Miami, FL, USA.
C Hendricks BrownFeinberg School of Medicine Northwestern University, Chicago, IL, USA.

Funding

Use of topic modeling and stakeholderengagement to map determinants of implementation disparities in addiction and pain researchU2CDA057717 · NIDA · STANFORD UNIVERSITY · PI C. HENDRICKS BROWN · 2022 to 2026
$19.1M
Transforming health equity rhetoric to rigor: Development and validation of a novel measure assessing health equity in implementation of health interventionsP50DA054072 · NIDA · STANFORD UNIVERSITY · PI Mark P McGovern · 2022 to 2026
$18.1M
Resource CoreP30AR072579 · NIAMS · NORTHWESTERN UNIVERSITY AT CHICAGO · PI Leena Sharma · 2017 to 2026
$8.3M
Implementation and Evaluation of an Expanded Bilingual Electronic Symptom Management Program across a Multi-site, Fully-integrated Comprehensive Cancer CenterUM1CA233035 · NCI · NORTHWESTERN UNIVERSITY AT CHICAGO · PI CELLA, DAVID · 2018 to 2021
$8.1M
Community Development Teams to Scale-Up MTFC in CaliforniaR01MH076158 · NIMH · CENTER FOR RESEARCH TO PRACTICE, INC. · PI CHAMBERLAIN, PATRICIA · 2006 to 2011
$5.7M
Scaling a Parenting EBI for Latinx Youth Mental Health in Primary CareR01MH124718 · NIMH · UNIVERSITY OF MIAMI CORAL GABLES · PI BROWN, C. HENDRICKS, PRADO, GUILLERMO · 2021 to 2024
$3.0M
NCI NIH HHS UM1 CA233035NIAMS NIH HHS P30 AR072579NIDA NIH HHS P50 DA054072NIDA NIH HHS P50DA054072NIDA NIH HHS U2C DA057717NIMH NIH HHS R01 MH076158NIMH NIH HHS R01 MH124718
6 · The paper itself

Abstract

backgroundRollout designs, which include stepped wedge designs, are defined by staggered implementation of new or alternative programs or services. Critiques of stepped wedge and other rollout designs have raised concerns regarding the confounding of true implementation or program effects with unrelated, global changes in service delivery, with some recommending they only be used when traditional parallel-group designs are not practicable. However, rollout designs may sometimes be more suitable than traditional parallel group designs for ethical, scientific, or practical reasons.

resultsAs investigators involved in several recent rollout trials, we define and provide rationale for and examples of stepped wedge and the larger class of rollout designs, in which all participating units receive a new program or service implementation. Staged implementation in a rollout design may be necessary when denying, rather than delaying, implementation of a known effective service is ethically unacceptable. Scientifically, stepped wedge has increased statistical power relative to an equivalent parallel group design, and some rollout designs have the capability to compare different phases of implementation and sustainment. A rollout design may be practically necessary either because of limited resources and other logistical challenges or community requirements that no site serve as a control. Examples of completed and ongoing rollout trials illustrate how these ethical, scientific, and practical considerations influenced trial designs.

conclusionsStepped wedge and other rollout trial designs may be well suited to evaluation of implementation strategies or policy changes. In implementation trials, rollout designs may be necessary for practical reasons, may be required for ethical reasons, and may be preferred for scientific reasons. We summarize when such rollout designs have advantages and drawbacks.

Indexed as

Implementation ScienceResearch DesignHumans

Identifiers

PMID39994781
PMCPMC11849316

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.