Evidence map›Paper›PMID 29361833›Full record

ArticleClinical trials (London, England)2018

Are pilot trials useful for predicting randomisation and attrition rates in definitive studies: A review of publicly funded trials.

Cindy L Cooper, Amy Whitehead, Edward Pottrill, Steven A Julious, Stephen J Walters

Abstract read
In one paragraph

Article in Clinical trials (London, England), 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 35 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
35citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

35 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. A technology-based intervention to reduce alcohol use after metabolic and bariatric surgery: feasibility, acceptability, and preliminary outcomes.Surgery for obesity and related diseases : official journal of the American Society for Bariatric Surgery · 2025
    Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Cindy L Cooper1 Clinical Trials Research Unit, School of Health and Related Research (ScHARR), The University of Sheffield, Sheffield, UK.ORCID 0000-0002-2995-5447
Amy Whitehead2 School of Health and Related Research (ScHARR), The University of Sheffield, Sheffield, UK.
Edward Pottrill2 School of Health and Related Research (ScHARR), The University of Sheffield, Sheffield, UK.
Steven A Julious2 School of Health and Related Research (ScHARR), The University of Sheffield, Sheffield, UK.
Stephen J Walters2 School of Health and Related Research (ScHARR), The University of Sheffield, Sheffield, UK.

Funding

Wellcome Trust
6 · The paper itself

Abstract

BACKGROUND/

aimsExternal pilot trials are recommended for testing the feasibility of main or confirmatory trials. However, there is little evidence that progress in external pilot trials actually predicts randomisation and attrition rates in the main trial. To assess the use of external pilot trials in trial design, we compared randomisation and attrition rates in publicly funded randomised controlled trials with rates in their pilots.

methodsRandomised controlled trials for which there was an external pilot trial were identified from reports published between 2004 and 2013 in the Health Technology Assessment Journal. Data were extracted from published papers, protocols and reports. Bland-Altman plots and descriptive statistics were used to investigate the agreement of randomisation and attrition rates between the full and external pilot trials.

resultsOf 561 reports, 41 were randomised controlled trials with pilot trials and 16 met criteria for a pilot trial with sufficient data. Mean attrition and randomisation rates were 21.1% and 50.4%, respectively, in the pilot trials and 16.8% and 65.2% in the main. There was minimal bias in the pilot trial when predicting the main trial attrition and randomisation rate. However, the variation was large: the mean difference in the attrition rate between the pilot and main trial was -4.4% with limits of agreement of -37.1% to 28.2%. Limits of agreement for randomisation rates were -47.8% to 77.5%.

conclusionResults from external pilot trials to estimate randomisation and attrition rates should be used with caution as comparison of the difference in the rates between pilots and their associated full trial demonstrates high variability. We suggest using internal pilot trials wherever appropriate.

Indexed as

Patient DropoutsPilot ProjectsRandomized Controlled Trials as TopicHumansPatient SelectionattritiondropoutfeasibilityPilot trialrandomisationrecruitmenttrial design

Identifiers

PMID29361833
PMCPMC5894808

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.