Evidence map›Paper›PMID 15743523›Full record

SynthesisBMC medical research methodology2005

Methodological bias in cluster randomised trials.

Seokyung Hahn, Suezann Puffer, David J Torgerson, Judith Watson

2 registry-linked trialsOpen access · goldAbstract readSystematic Review
In one paragraph

Synthesis in BMC medical research methodology, 2005. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 112 papers, 31 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
112citing papers in PubMed, 31 pooled it
22.7field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT01436331 nacompletednot on this mapstarted 2010, after this paper: background citation

A Pragmatic Cluster Randomized Controlled Trial of a Multi-element Psychosocial Intervention for Early Psychosis in a 10 Million Inhabitant Catchment Area Aimed to Measure the Treatment's Feasibility and Effectiveness: GET UP-PIANO Trial

TypeinterventionalSponsorUniversita di VeronaRan2010 to 2012Enrolled626ConditionsPsychosisArmsTreatment As Usual (TAU), TAU+CBT for pts+Family Intervention+CM.
NCT05782166 naunknown statusnot on this mapstarted 2024, after this paper: background citation

Cross-Cultural Adaptation of a Betel Quid Cessation Program and Evaluation of Its Effectiveness in a Malaysian High-Risk Community

TypeinterventionalSponsorUniversity of MalayaRan2024 to 2024Enrolled92ConditionsBetel Nut Chewer, Tobacco CessationArmsBetel Quid Educational Booklet, Betel Quid Cessation Intervention Module
3 · Its place in the literature

Who cites it

112 citing papers in PubMed, 31 syntheses or guidelines pooled it, 311 citations in OpenAlex.

  1. Interventions for preventing falls in older people in hospitals.The Cochrane database of systematic reviews · 2026
    Pooled it
  2. Interventions for preventing falls in older people in care facilities.The Cochrane database of systematic reviews · 2025
    Pooled it
  3. Interventions for postburn pruritus.The Cochrane database of systematic reviews · 2024
    Pooled it
  4. Pooled it
  5. Collaborative care approaches for people with severe mental illness.The Cochrane database of systematic reviews · 2024
    Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Risk assessment tools for the prevention of pressure ulcers.The Cochrane database of systematic reviews · 2019
    Pooled it
  13. Organisation of health services for preventing and treating pressure ulcers.The Cochrane database of systematic reviews · 2018
    Pooled it
  14. Pooled it
  15. Tobacco cessation interventions for young people.The Cochrane database of systematic reviews · 2017
    Pooled it
  16. Antiseptics for burns.The Cochrane database of systematic reviews · 2017
    Pooled it
  17. Antibiotics and antiseptics for pressure ulcers.The Cochrane database of systematic reviews · 2016
    Pooled it
  18. Pooled it
  19. Pooled it
  20. Prenatal education for congenital toxoplasmosis.The Cochrane database of systematic reviews · 2015
    Pooled it

52 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 1 institution in 1 country.

Seokyung HahnMedical Research Collaborating Center, Seoul National University College of Medicine, 2nd Floor Cancer Research Institute Building, 28 Yongon Dong, Chongno Gu, Seoul 110-744, Korea. hahns@snu.ac.kr <hahns@snu.ac.kr>
Suezann Puffer
David J Torgerson
Judith Watson
National University College · PR

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundCluster randomised trials can be susceptible to a range of methodological problems. These problems are not commonly recognised by many researchers. In this paper we discuss the issues that can lead to bias in cluster trials.

methodsWe used a sample of cluster randomised trials from a recent review and from a systematic review of hip protectors. We compared the mean age of participants between intervention groups in a sample of 'good' cluster trials with a sample of potentially biased trials. We also compared the effect sizes, in a funnel plot, between hip protector trials that used individual randomisation compared with those that used cluster randomisation.

resultsThere is a tendency for cluster trials, with evidence methodological biases, to also show an age imbalance between treatment groups. In a funnel plot we show that all cluster trials show a large positive effect of hip protectors whilst individually randomised trials show a range of positive and negative effects, suggesting that cluster trials may be producing a biased estimate of effect.

conclusionMethodological biases in the design and execution of cluster randomised trials is frequent. Some of these biases associated with the use of cluster designs can be avoided through careful attention to the design of cluster trials. Firstly, if possible, individual allocation should be used. Secondly, if cluster allocation is required, then ideally participants should be identified before random allocation of the clusters. Third, if prior identification is not possible, then an independent recruiter should be used to recruit participants.

Indexed as

Cluster AnalysisSelection BiasAge FactorsHip FracturesHumansInformed ConsentPatient SelectionPeriodicals as TopicProtective DevicesRandomized Controlled Trials as TopicRefusal to ParticipateResearch DesignSample Size

Identifiers

PMID15743523
PMCPMC554774
OpenAlexW1561225387

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.