Evidence map›Paper›PMID 22100793›Full record

Trial reportJournal of medical Internet research2011

Impact of length or relevance of questionnaires on attrition in online trials: randomized controlled trial.

Jim McCambridge, Eleftheria Kalaitzaki, Ian R White, Zarnie Khadjesari, Elizabeth Murray, Stuart Linke, Simon G Thompson, Christine Godfrey, Paul Wallace

Open access · goldAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of medical Internet research, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 44 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
44citing papers in PubMed, 6 pooled it
3.5field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

44 citing papers in PubMed, 6 syntheses or guidelines pooled it, 78 citations in OpenAlex.

  1. Methods to increase response to postal and electronic questionnaires.The Cochrane database of systematic reviews · 2023
    Pooled it
  2. Strategies to improve retention in randomised trials.The Cochrane database of systematic reviews · 2021
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Strategies to improve retention in randomised trials.The Cochrane database of systematic reviews · 2013
    Pooled it
  6. Pooled it
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Article
  14. Article
  15. Article
  16. "Geriatrics (Basel, Switzerland) · 2024
    Article
  17. Embedding research study recruitment within the patient portal preCheck-in.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 5 institutions in 1 country.

Jim McCambridgeFaculty of Public Health & Policy, London School of Hygiene & Tropical Medicine, London, United Kingdom. Jim.McCambridge@lshtm.ac.uk
Eleftheria Kalaitzaki
Ian R White
Zarnie Khadjesari
Elizabeth Murray
Stuart Linke
Simon G Thompson
Christine Godfrey
Paul Wallace
University College London · GBMRC Biostatistics Unit · GBFramework · GBUniversity of London · GBUniversity of York · GB

Funding

British Heart Foundation RG/08/014/24067Cancer Research UKChief Scientist OfficeDepartment of HealthMedical Research Council G0501298Medical Research Council MC_U105260558Medical Research Council MC_U105260792Medical Research Council U.1052.00.006Wellcome Trust WT086516MA
6 · The paper itself

Abstract

backgroundThere has been limited study of factors influencing response rates and attrition in online research. Online experiments were nested within the pilot (study 1, n = 3780) and main trial (study 2, n = 2667) phases of an evaluation of a Web-based intervention for hazardous drinkers: the Down Your Drink randomized controlled trial (DYD-RCT).

objectivesThe objective was to determine whether differences in the length and relevance of questionnaires can impact upon loss to follow-up in online trials.

methodsA randomized controlled trial design was used. All participants who consented to enter DYD-RCT and completed the primary outcome questionnaires were randomized to complete one of four secondary outcome questionnaires at baseline and at follow-up. These questionnaires varied in length (additional 23 or 34 versus 10 items) and relevance (alcohol problems versus mental health). The outcome measure was the proportion of participants who completed follow-up at each of two follow-up intervals: study 1 after 1 and 3 months and study 2 after 3 and 12 months.

resultsAt all four follow-up intervals there were no significant effects of additional questionnaire length on follow-up. Randomization to the less relevant questionnaire resulted in significantly lower rates of follow-up in two of the four assessments made (absolute difference of 4%, 95% confidence interval [CI] 0%-8%, in both study 1 after 1 month and in study 2 after 12 months). A post hoc pooled analysis across all four follow-up intervals found this effect of marginal statistical significance (unadjusted difference, 3%, range 1%-5%, P = .01; difference adjusted for prespecified covariates, 3%, range 0%-5%, P = .05).

conclusionsApparently minor differences in study design decisions may have a measurable impact on attrition in trials. Further investigation is warranted of the impact of the relevance of outcome measures on follow-up rates and, more broadly, of the consequences of what we ask participants to do when we invite them to take part in research studies.

trial registrationISRCTN Register 31070347; http://www.controlled-trials.com/ISRCTN31070347/31070347 Archived by WebCite at (http://www.webcitation.org/62cpeyYaY).

Indexed as

InternetSurveys and QuestionnairesAdultAlcohol DrinkingFemaleHumansMaleMiddle AgedPatient DropoutsPilot Projects

Identifiers

PMID22100793
PMCPMC3236666
OpenAlexW2092473517

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.