Evidence map›Paper›PMID 21548947›Full record

Trial reportBMC medical research methodology2011

Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial.

Shannon Sahlqvist, Yena Song, Fiona Bull, Emma Adams, John Preston, David Ogilvie, iConnect consortium

Open access · goldAbstract readRandomized Controlled Trial
In one paragraph

Trial report in BMC medical research methodology, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 144 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
144citing papers in PubMed, 1 pooled it
38.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

144 citing papers in PubMed, 1 synthesis or guideline pooled it, 364 citations in OpenAlex.

  1. Methods to increase response to postal and electronic questionnaires.The Cochrane database of systematic reviews · 2023
    Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. The effect of reminders in a web-based intervention study.European journal of epidemiology · 2012
    Trial
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Observational
  20. Article

84 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 4 institutions in 2 countries.

Shannon SahlqvistMedical Research Council Epidemiology Unit and UKCRC Centre for Diet and Activity Research (CEDAR), Box 296, Institute of Public Health, Forvie Site, Robinson Way, Cambridge, CB2 0SR, UK. slf45@medschl.cam.ac.uk
Yena Song
Fiona Bull
Emma Adams
John Preston
David Ogilvie
iConnect consortium
Loughborough University · GBUniversity of Southampton · GBMedical Research Council · GBMRC Epidemiology Unit · GB

Funding

Medical Research Council MC_U106179474
6 · The paper itself

Abstract

backgroundMinimising participant non-response in postal surveys helps to maximise the generalisability of the inferences made from the data collected. The aim of this study was to examine the effect of questionnaire length, personalisation and reminder type on postal survey response rate and quality and to compare the cost-effectiveness of the alternative survey strategies.

methodsIn a pilot study for a population study of travel behaviour, physical activity and the environment, 1000 participants sampled from the UK edited electoral register were randomly allocated using a 2×2 factorial design to receive one of four survey packs: a personally addressed long (24 page) questionnaire pack, a personally addressed short (15 page) questionnaire pack, a non-personally addressed long questionnaire pack or a non-personally addressed short questionnaire pack. Those who did not return a questionnaire were stratified by initial randomisation group and further randomised to receive either a full reminder pack or a reminder postcard. The effects of the survey design factors on response were examined using multivariate logistic regression.

resultsAn overall response rate of 17% was achieved. Participants who received the short version of the questionnaire were more likely to respond (OR=1.48, 95% CI 1.06 to 2.07). In those participants who received a reminder, personalisation of the survey pack and reminder also increased the odds of response (OR=1.44, 95% CI 1.01 to 1.95). Item non-response was relatively low, but was significantly higher in the long questionnaire than the short (9.8% vs 5.8%; p=.04). The cost per additional usable questionnaire returned of issuing the reminder packs was £23.1 compared with £11.3 for the reminder postcards.

conclusionsIn contrast to some previous studies of shorter questionnaires, this trial found that shortening a relatively lengthy questionnaire significantly increased the response. Researchers should consider the trade off between the value of additional questions and a larger sample. If low response rates are expected, personalisation may be an important strategy to apply. Sending a full reminder pack to non-respondents appears a worthwhile, albeit more costly, strategy.

Indexed as

Data CollectionCommunity ParticipationCost-Benefit AnalysisEnvironmentHumansMotor ActivityReminder SystemsSurveys and QuestionnairesTravel

Identifiers

PMID21548947
PMCPMC3110121
OpenAlexW1965067262

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.