Evidence map›Paper›PMID 29468635›Full record

SynthesisThe Cochrane database of systematic reviews2018

Strategies to improve recruitment to randomised trials.

Shaun Treweek, Marie Pitkethly, Jonathan Cook, Cynthia Fraser, Elizabeth Mitchell, Frank Sullivan, Catherine Jackson, Tyna K Taskila, Heidi Gardner

Registry-linked trialAbstract readSystematic Review
In one paragraph

Synthesis in The Cochrane database of systematic reviews, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03511482 (An Open Feasibility Study to Investigate the Impact of A Digitally Delivered Asthma Service for Patients in Primary Care), which is not on this map. Cited by 374 papers, 19 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
374citing papers in PubMed, 19 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03511482 nawithdrawnnot on this mapstarted 2019, after this paper: background citation

An Open Feasibility Study to Investigate the Impact of A Digitally Delivered Asthma Service for Patients in Primary Care (IDEAL-001: Integrated Digitally EnhAnced Care for Long-term Conditions-001

TypeinterventionalSponsormy mhealth LtdRan2019 to 2021Enrolled0ConditionsAsthmaArmsmyAsthma Application, Lloyds Pharmacy Online Doctor
3 · Its place in the literature

Who cites it

374 citing papers in PubMed, 19 syntheses or guidelines pooled it.

  1. Strategies to improve recruitment to randomised trials.The Cochrane database of systematic reviews · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Guideline
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Pooled it
  13. Pooled it
  14. Pooled it
  15. Pooled it
  16. Pooled it
  17. Pooled it
  18. Pooled it
  19. Pooled it
  20. Trial

314 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

9 authors.

Shaun TreweekHealth Services Research Unit, University of Aberdeen, Foresterhill, Aberdeen, UK, AB25 2ZD.
Marie Pitkethly
Jonathan Cook
Cynthia Fraser
Elizabeth Mitchell
Frank Sullivan
Catherine Jackson
Tyna K Taskila
Heidi Gardner

Funding

Chief Scientist Office HSRU1Medical Research Council MR/K025643/1
6 · The paper itself

Abstract

backgroundRecruiting participants to trials can be extremely difficult. Identifying strategies that improve trial recruitment would benefit both trialists and health research.

objectivesTo quantify the effects of strategies for improving recruitment of participants to randomised trials. A secondary objective is to assess the evidence for the effect of the research setting (e.g. primary care versus secondary care) on recruitment. SEARCH

methodsWe searched the Cochrane Methodology Review Group Specialised Register (CMR) in the Cochrane Library (July 2012, searched 11 February 2015); MEDLINE and MEDLINE In Process (OVID) (1946 to 10 February 2015); Embase (OVID) (1996 to 2015 Week 06); Science Citation Index & Social Science Citation Index (ISI) (2009 to 11 February 2015) and ERIC (EBSCO) (2009 to 11 February 2015). SELECTION CRITERIA: Randomised and quasi-randomised trials of methods to increase recruitment to randomised trials. This includes non-healthcare studies and studies recruiting to hypothetical trials. We excluded studies aiming to increase response rates to questionnaires or trial retention and those evaluating incentives and disincentives for clinicians to recruit participants. DATA COLLECTION AND ANALYSIS: We extracted data on: the method evaluated; country in which the study was carried out; nature of the population; nature of the study setting; nature of the study to be recruited into; randomisation or quasi-randomisation method; and numbers and proportions in each intervention group. We used a risk difference to estimate the absolute improvement and the 95% confidence interval (CI) to describe the effect in individual trials. We assessed heterogeneity between trial results. We used GRADE to judge the certainty we had in the evidence coming from each comparison. MAIN

resultsWe identified 68 eligible trials (24 new to this update) with more than 74,000 participants. There were 63 studies involving interventions aimed directly at trial participants, while five evaluated interventions aimed at people recruiting participants. All studies were in health care.We found 72 comparisons, but just three are supported by high-certainty evidence according to GRADE.1. Open trials rather than blinded, placebo trials. The absolute improvement was 10% (95% CI 7% to 13%).2. Telephone reminders to people who do not respond to a postal invitation. The absolute improvement was 6% (95% CI 3% to 9%). This result applies to trials that have low underlying recruitment. We are less certain for trials that start out with moderately good recruitment (i.e. over 10%).3. Using a particular, bespoke, user-testing approach to develop participant information leaflets. This method involved spending a lot of time working with the target population for recruitment to decide on the content, format and appearance of the participant information leaflet. This made little or no difference to recruitment: absolute improvement was 1% (95% CI -1% to 3%).We had moderate-certainty evidence for eight other comparisons; our confidence was reduced for most of these because the results came from a single study. Three of the methods were changes to trial management, three were changes to how potential participants received information, one was aimed at recruiters, and the last was a test of financial incentives. All of these comparisons would benefit from other researchers replicating the evaluation. There were no evaluations in paediatric trials.We had much less confidence in the other 61 comparisons because the studies had design flaws, were single studies, had very uncertain results or were hypothetical (mock) trials rather than real ones. AUTHORS'

conclusionsThe literature on interventions to improve recruitment to trials has plenty of variety but little depth. Only 3 of 72 comparisons are supported by high-certainty evidence according to GRADE: having an open trial and using telephone reminders to non-responders to postal interventions both increase recruitment; a specialised way of developing participant information leaflets had little or no effect. The methodology research community should improve the evidence base by replicating evaluations of existing strategies, rather than developing and testing new ones.

Indexed as

Patient SelectionRandomized Controlled Trials as TopicReminder SystemsHumansPatient Education as TopicSample SizeTelephone

Identifiers

PMID29468635
PMCPMC7078793

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.