Evidence map›Paper›PMID 26846897›Full record

SynthesisBMJ open2016

Systematic review finds major deficiencies in sample size methodology and reporting for stepped-wedge cluster randomised trials.

James Martin, Monica Taljaard, Alan Girling, Karla Hemming

Registry-linked trialAbstract readSystematic Review
In one paragraph

Synthesis in BMJ open, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04789902 (A Stepped Wedge Cluster Randomized Trial Designed to Evaluate the Effects of SurgeCon), which is not on this map. Cited by 37 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
37citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04789902 naactive not recruitingnot on this mapstarted 2021, after this paper: background citation

A Stepped Wedge Cluster Randomized Trial Designed to Evaluate the Effects of SurgeCon: A Quality Improvement Surge Management Platform

TypeinterventionalSponsorMemorial University of NewfoundlandRan2021 to 2026Enrolled436,052ConditionsLength of Stay, Emergency DepartmentsArmsSurgeCon
3 · Its place in the literature

Who cites it

37 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Review
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

James MartinSchool of Health and Population Sciences, University of Birmingham, Birmingham, UK.
Monica TaljaardClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada Department of Epidemiology and Community Medicine, University of Ottawa, Ottawa, Ontario, Canada.
Alan GirlingSchool of Health and Population Sciences, University of Birmingham, Birmingham, UK.
Karla HemmingSchool of Health and Population Sciences, University of Birmingham, Birmingham, UK.

Funding

Department of Health WMCLAHRC-2014-1Medical Research Council G0800808
6 · The paper itself

Abstract

backgroundStepped-wedge cluster randomised trials (SW-CRT) are increasingly being used in health policy and services research, but unless they are conducted and reported to the highest methodological standards, they are unlikely to be useful to decision-makers. Sample size calculations for these designs require allowance for clustering, time effects and repeated measures.

methodsWe carried out a methodological review of SW-CRTs up to October 2014. We assessed adherence to reporting each of the 9 sample size calculation items recommended in the 2012 extension of the CONSORT statement to cluster trials.

resultsWe identified 32 completed trials and 28 independent protocols published between 1987 and 2014. Of these, 45 (75%) reported a sample size calculation, with a median of 5.0 (IQR 2.5-6.0) of the 9 CONSORT items reported. Of those that reported a sample size calculation, the majority, 33 (73%), allowed for clustering, but just 15 (33%) allowed for time effects. There was a small increase in the proportions reporting a sample size calculation (from 64% before to 84% after publication of the CONSORT extension, p=0.07). The type of design (cohort or cross-sectional) was not reported clearly in the majority of studies, but cohort designs seemed to be most prevalent. Sample size calculations in cohort designs were particularly poor with only 3 out of 24 (13%) of these studies allowing for repeated measures. DISCUSSION: The quality of reporting of sample size items in stepped-wedge trials is suboptimal. There is an urgent need for dissemination of the appropriate guidelines for reporting and methodological development to match the proliferation of the use of this design in practice. Time effects and repeated measures should be considered in all SW-CRT power calculations, and there should be clarity in reporting trials as cohort or cross-sectional designs.

Indexed as

Research DesignResearch ReportCluster AnalysisHealth PolicyHumansRandomized Controlled Trials as TopicSample SizeclusterCONSORTrandomised trial

Identifiers

PMID26846897
PMCPMC4746455

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.