Evidence map›Paper›PMID 36600344›Full record

ArticleBMJ open2022

Reporting of and explanations for under-recruitment and over-recruitment in pragmatic trials: a secondary analysis of a database of primary trial reports published from 2014 to 2019.

Pascale Nevins, Stuart G Nicholls, Yongdong Ouyang, Kelly Carroll, Karla Hemming, Charles Weijer, Monica Taljaard

Abstract read
In one paragraph

Article in BMJ open, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Pascale NevinsDepartment of Chemistry and Biomolecular Sciences, University of Ottawa Faculty of Science, Ottawa, Ontario, Canada.ORCID 0000-0002-4488-7366
Stuart G NichollsClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Yongdong OuyangClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Kelly CarrollClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Karla HemmingInstitute of Applied Health Research, University of Birmingham, Birmingham, UK.
Charles WeijerDepartments of Medicine, Epidemiology & Biostatistics, and Philosophy, Western University, London, Ontario, Canada.ORCID 0000-0002-5510-1074
Monica TaljaardSchool of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada mtaljaard@ohri.ca.ORCID 0000-0002-3978-8961

Funding

Training Core (I)U54AG063546 · NIA · BROWN UNIVERSITY · PI JOSEPH E. GAUGLER · 2019 to 2026
$125.9M
CIHR PJT-153045
6 · The paper itself

Abstract

objectivesTo describe the extent to which pragmatic trials underachieved or overachieved their target sample sizes, examine explanations and identify characteristics associated with under-recruitment and over-recruitment. STUDY DESIGN AND

settingSecondary analysis of an existing database of primary trial reports published during 2014-2019, registered in ClinicalTrials.gov, self-labelled as pragmatic and with target and achieved sample sizes available.

resultsOf 372 eligible trials, the prevalence of under-recruitment (achieving <90% of target sample size) was 71 (19.1%) and of over-recruitment (>110% of target) was 87 (23.4%). Under-recruiting trials commonly acknowledged that they did not achieve their targets (51, 71.8%), with the majority providing an explanation, but only 11 (12.6%) over-recruiting trials acknowledged recruitment excess. The prevalence of under-recruitment in individually randomised versus cluster randomised trials was 41 (17.0%) and 30 (22.9%), respectively; prevalence of over-recruitment was 39 (16.2%) vs 48 (36.7%), respectively. Overall, 101 025 participants were recruited to trials that did not achieve at least 90% of their target sample size. When considering trials with over-recruitment, the total number of participants recruited in excess of the target was a median (Q1-Q3) 319 (75-1478) per trial for an overall total of 555 309 more participants than targeted. In multinomial logistic regression, cluster randomisation and lower journal impact factor were significantly associated with both under-recruitment and over-recruitment, while using exclusively routinely collected data and educational/behavioural interventions were significantly associated with over-recruitment; we were unable to detect significant associations with obtaining consent, publication year, country of recruitment or public engagement.

conclusionsA clear explanation for under-recruitment or over-recruitment in pragmatic trials should be provided to encourage transparency in research, and to inform recruitment to future trials with comparable designs. The issues and ethical implications of over-recruitment should be more widely recognised by trialists, particularly when designing cluster randomised trials.

Indexed as

Patient SelectionPragmatic Clinical Trials as TopicDatabases, FactualHumansPrevalencePublicationsSample SizeClinical trialsMEDICAL ETHICSSTATISTICS & RESEARCH METHODS

Identifiers

PMID36600344
PMCPMC9743401

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.