Evidence map›Paper›PMID 31053157›Full record

Trial reportImplementation science : IS2019

A method to reduce imbalance for site-level randomized stepped wedge implementation trial designs.

Robert A Lew, Christopher J Miller, Bo Kim, Hongsheng Wu, Kelly Stolzmann, Mark S Bauer

Registry-linked trialAbstract readMulticenter StudyRandomized Controlled Trial
In one paragraph

Trial report in Implementation science : IS, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT02543840 (Hybrid Controlled Trial to Implement Collaborative Care in General Mental Health), which is not on this map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT02543840 nacompletednot on this map

Hybrid Controlled Trial to Implement Collaborative Care in General Mental Health

TypeinterventionalSponsorVA Boston Healthcare SystemRan2016 to 2018Enrolled1,112ConditionsMental Health DisordersArmsReplicating Effective Programs plus External Facilitation, Educational Materials
3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Trial
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Robert A LewVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research, 150 South Huntington Avenue, Jamaica Plain, Boston, MA, 02130, USA.
Christopher J MillerVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research, 150 South Huntington Avenue, Jamaica Plain, Boston, MA, 02130, USA.
Bo KimVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research, 150 South Huntington Avenue, Jamaica Plain, Boston, MA, 02130, USA.
Hongsheng WuDepartment of Computer Science & Networking, Wentworth Institute of Technology, Boston, USA.
Kelly StolzmannVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research, 150 South Huntington Avenue, Jamaica Plain, Boston, MA, 02130, USA.
Mark S BauerVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research, 150 South Huntington Avenue, Jamaica Plain, Boston, MA, 02130, USA. Mark.Bauer@va.gov.ORCID 0000-0001-6507-9918

Funding

HSRD VA QUE 15-289
6 · The paper itself

Abstract

backgroundControlled implementation trials often randomize the intervention at the site level, enrolling relatively few sites (e.g., 6-20) compared to trials that randomize by subject. Trials with few sites carry a substantial risk of an imbalance between intervened (cases) and non-intervened (control) sites in important site characteristics, thereby threatening the internal validity of the primary comparison. A stepped wedge design (SWD) staggers the intervention at sites over a sequence of times or time waves until all sites eventually receive the intervention. We propose a new randomization method, sequential balance, to control time trend in site allocation by minimizing sequential imbalance across multiple characteristics. We illustrate the new method by applying it to a SWD implementation trial.

methodsThe trial investigated the impact of blended internal-external facilitation on the establishment of evidence-based teams in general mental health clinics in nine US Department of Veterans Affairs medical centers. Prior to randomization to start time, an expert panel of implementation researchers and health system program leaders identified by consensus a series of eight facility-level characteristics judged relevant to the success of implementation. We characterized each of the nine sites according to these consensus features. Using a weighted sum of these characteristics, we calculated imbalance scores for each of 1680 possible site assignments to identify the most sequentially balanced assignment schemes.

resultsFrom 1680 possible site assignments, we identified 34 assignments with minimal imbalance scores, and then randomly selected one assignment by which to randomize start time. Initially, the mean imbalance score was 3.10, but restricted to the 34 assignments, it declined to 0.99.

conclusionsSequential balancing of site characteristics across groups of sites in the time waves of a SWD strengthens the internal validity of study conclusions by minimizing potential confounding.

trial registrationRegistered at ClinicalTrials.gov as clinical trials # NCT02543840 ; entered 9/4/2015.

Indexed as

Research DesignEvidence-Based MedicineHospitals, VeteransHumansMental DisordersProgram DevelopmentQuality ImprovementUnited StatesUnited States Department of Veterans AffairsImbalanceNested control trailsStepped wedge

Identifiers

PMID31053157
PMCPMC6500026

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.