Evidence map›Paper›PMID 35834775›Full record

ArticleInternational journal of epidemiology2023

Estimands in cluster-randomized trials: choosing analyses that answer the right question.

Brennan C Kahan, Fan Li, Andrew J Copas, Michael O Harhay

Abstract read
In one paragraph

Article in International journal of epidemiology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 73 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
73citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

73 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Principal stratification with U-statistics under principal ignorability.Journal of the Royal Statistical Society. Series B, Statistical methodology · 2026
    Article
  15. Article
  16. Model-robust standardization in stepped wedge cluster randomized trials.Journal of the Royal Statistical Society. Series A, (Statistics in Society) · 2026
    Article
  17. Article
  18. Use of estimands in cluster randomised trials: A review.Clinical trials (London, England) · 2026
    Review
  19. Article
  20. Article

13 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Brennan C KahanMRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, London, UK.
Fan LiDepartment of Biostatistics, Yale University School of Public Health, New Haven, CT, USA.ORCID 0000-0001-6183-1893
Andrew J CopasMRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, London, UK.
Michael O HarhayClinical Trials Methods and Outcomes Lab, PAIR (Palliative and Advanced Illness Research) Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.ORCID 0000-0002-0553-674X

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Improving the measurement and analysis of long-term, patient-centered outcomes following acute respiratory failureR00HL141678 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI HARHAY, MICHAEL OSCAR · 2020 to 2022
$747k
Medical Research Council MC_UU_00004/07Medical Research Council MC_UU_00004/09NCATS NIH HHS UL1 TR001863NHLBI NIH HHS R00 HL141678
6 · The paper itself

Abstract

backgroundCluster-randomized trials (CRTs) involve randomizing groups of individuals (e.g. hospitals, schools or villages) to different interventions. Various approaches exist for analysing CRTs but there has been little discussion around the treatment effects (estimands) targeted by each.

methodsWe describe the different estimands that can be addressed through CRTs and demonstrate how choices between different analytic approaches can impact the interpretation of results by fundamentally changing the question being asked, or, equivalently, the target estimand.

resultsCRTs can address either the participant-average treatment effect (the average treatment effect across participants) or the cluster-average treatment effect (the average treatment effect across clusters). These two estimands can differ when participant outcomes or the treatment effect depends on the cluster size (referred to as 'informative cluster size'), which can occur for reasons such as differences in staffing levels or types of participants between small and large clusters. Furthermore, common estimators, such as mixed-effects models or generalized estimating equations with an exchangeable working correlation structure, can produce biased estimates for both the participant-average and cluster-average treatment effects when cluster size is informative. We describe alternative estimators (independence estimating equations and cluster-level analyses) that are unbiased for CRTs even when informative cluster size is present.

conclusionWe conclude that careful specification of the estimand at the outset can ensure that the study question being addressed is clear and relevant, and, in turn, that the selected estimator provides an unbiased estimate of the desired quantity.

Indexed as

Research DesignCluster AnalysisComputer SimulationHumansRandomized Controlled Trials as TopicSample Sizecluster-average treatment effectcluster-randomized trialestimandsindependence estimating equationsinformative cluster sizeParticipant-average treatment effect

Identifiers

PMID35834775
PMCPMC9908044

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.