Evidence map›Paper›PMID 30305146›Full record

ArticleTrials2018

A study of target effect sizes in randomised controlled trials published in the Health Technology Assessment journal.

Joanne C Rothwell, Steven A Julious, Cindy L Cooper

Abstract read
In one paragraph

Article in Trials, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 37 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
37citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

37 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Communication Bridge-2 randomized controlled trial: Recruitment and baseline features.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2025
    Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Joanne C RothwellSchool of Health and Related Research, University of Sheffield, Sheffield, UK. j.c.rothwell@sheffield.ac.uk.ORCID http://orcid.org/0000-0001-6275-3807
Steven A JuliousSchool of Health and Related Research, University of Sheffield, Sheffield, UK.
Cindy L CooperSheffield Clinical Trials Unit, University of Sheffield, Sheffield, UK.

Funding

Medical Research Council G0701013
6 · The paper itself

Abstract

backgroundWhen designing a randomised controlled trial (RCT), an important consideration is the sample size required. This is calculated from several components; one of which is the target difference. This study aims to review the currently reported methods of elicitation of the target difference as well as to quantify the target differences used in Health Technology Assessment (HTA)-funded trials.

methodsTrials were identified from the National Institute of Health Research Health Technology Assessment journal. A total of 177 RCTs published between 2006 and 2016 were assessed for eligibility. Eligibility was established by the design of the trial and the quality of data available. The trial designs were parallel-group, superiority RCTs with a continuous primary endpoint. Data were extracted and the standardised anticipated and observed effect size estimates were calculated. Exclusion criteria was based on trials not providing enough detail in the sample size calculation and results, and trials not being of parallel-group, superiority design.

resultsA total of 107 RCTs were included in the study from 102 reports. The most commonly reported method for effect size derivation was a review of evidence and use of previous research (52.3%). This was common across all clinical areas. The median standardised target effect size was 0.30 (interquartile range: 0.20-0.38), with the median standardised observed effect size 0.11 (IQR 0.05-0.29). The maximum anticipated and observed effect sizes were 0.76 and 1.18, respectively. Only two trials had anticipated target values above 0.60.

conclusionThe most commonly reported method of elicitation of the target effect size is previous published research. The average target effect size was 0.3. A clear distinction between the target difference and the minimum clinically important difference is recommended when designing a trial. Transparent explanation of target difference elicitation is advised, with multiple methods including a review of evidence and opinion-seeking advised as the more optimal methods for effect size quantification.

Indexed as

Periodicals as TopicSample SizeHumansRandomized Controlled Trials as TopicTechnology Assessment, BiomedicalEffect sizeHealth technology assessmentHTARandomised controlled trialTarget difference

Identifiers

PMID30305146
PMCPMC6180439

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.