Evidence map›Paper›PMID 21371988›Full record

Trial reportJournal of medical Internet research2011

Impact and costs of incentives to reduce attrition in online trials: two randomized controlled trials.

Zarnie Khadjesari, Elizabeth Murray, Eleftheria Kalaitzaki, Ian R White, Jim McCambridge, Simon G Thompson, Paul Wallace, Christine Godfrey

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of medical Internet research, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 71 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
71citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

71 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Methods to increase response to postal and electronic questionnaires.The Cochrane database of systematic reviews · 2023
    Pooled it
  2. Strategies to improve retention in randomised trials.The Cochrane database of systematic reviews · 2021
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Strategies to improve retention in randomised trials.The Cochrane database of systematic reviews · 2013
    Pooled it
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Trial
  14. Trial
  15. Trial
  16. Trial
  17. Trial
  18. Trial
  19. Trial
  20. Trial

11 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Zarnie KhadjesariE-health Unit, Research Department of Primary Care and Population Health, University College London, London, United Kingdom. z.khadjesari@ucl.ac.uk
Elizabeth Murray
Eleftheria Kalaitzaki
Ian R White
Jim McCambridge
Simon G Thompson
Paul Wallace
Christine Godfrey

Funding

British Heart Foundation RG/08/014/24067Cancer Research UKChief Scientist OfficeDepartment of HealthMedical Research Council G0501298Medical Research Council MC_U105260558Medical Research Council MC_U105260792Medical Research Council MC_U122797165
6 · The paper itself

Abstract

backgroundAttrition from follow-up is a major methodological challenge in randomized trials. Incentives are known to improve response rates in cross-sectional postal and online surveys, yet few studies have investigated whether they can reduce attrition from follow-up in online trials, which are particularly vulnerable to low follow-up rates.

objectivesOur objective was to determine the impact of incentives on follow-up rates in an online trial.

methodsTwo randomized controlled trials were embedded in a large online trial of a Web-based intervention to reduce alcohol consumption (the Down Your Drink randomized controlled trial, DYD-RCT). Participants were those in the DYD pilot trial eligible for 3-month follow-up (study 1) and those eligible for 12-month follow-up in the DYD main trial (study 2). Participants in both studies were randomly allocated to receive an offer of an incentive or to receive no offer of an incentive. In study 1, participants in the incentive arm were randomly offered a £5 Amazon.co.uk gift voucher, a £5 charity donation to Cancer Research UK, or entry in a prize draw for £250. In study 2, participants in the incentive arm were offered a £10 Amazon.co.uk gift voucher. The primary outcome was the proportion of participants who completed follow-up questionnaires in the incentive arm(s) compared with the no incentive arm.

resultsIn study 1 (n = 1226), there was no significant difference in response rates between those participants offered an incentive (175/615, 29%) and those with no offer (162/611, 27%) (difference = 2%, 95% confidence interval [CI] -3% to 7%). There was no significant difference in response rates among the three different incentives offered. In study 2 (n = 2591), response rates were 9% higher in the group offered an incentive (476/1296, 37%) than in the group not offered an incentive (364/1295, 28%) (difference = 9%, 95% CI 5% to 12%, P < .001). The incremental cost per extra successful follow-up in the incentive arm was £110 in study 1 and £52 in study 2.

conclusionWhereas an offer of a £10 Amazon.co.uk gift voucher can increase follow-up rates in online trials, an offer of a lower incentive may not. The marginal costs involved require careful consideration.

trial registrationISRCTN31070347; http://www.controlled-trials.com/ISRCTN31070347 (Archived by WebCite at http://www.webcitation.org/5wgr5pl3s).

Indexed as

Alcohol DrinkingCosts and Cost AnalysisInternetMotivationAdultElectronic MailFemaleFollow-Up StudiesHumansMaleMiddle AgedPilot ProjectsTime Factors

Identifiers

PMID21371988
PMCPMC3221348

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.