Evidence map›Paper›PMID 31805869›Full record

ArticleBMC medical research methodology2019

Effectiveness of incentives and follow-up on increasing survey response rates and participation in field studies.

Michael G Smith, Maryam Witte, Sarah Rocha, Mathias Basner

Registry-linked trialAbstract read
In one paragraph

Article in BMC medical research methodology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05035940 (FAA National Sleep Study on the Effects of Aircraft Noise on Sleep), which is not on this map. Cited by 52 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
52citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05035940 active not recruitingnot on this mapstarted 2021, after this paper: background citation

FAA National Sleep Study on the Effects of Aircraft Noise on Sleep

TypeobservationalSponsorUniversity of PennsylvaniaRan2021 to 2026Enrolled401ConditionsNoise Exposure
3 · Its place in the literature

Who cites it

52 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Methods to increase response to postal and electronic questionnaires.The Cochrane database of systematic reviews · 2023
    Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Successful (and Unsuccessful) Recruitment Approaches and Participant Loss in a Down Syndrome Survey.American journal on intellectual and developmental disabilities · 2025
    Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Michael G SmithUnit for Experimental Psychiatry, Division of Sleep and Chronobiology, University of Pennsylvania Perelman School of Medicine, 1017 Blockley Hall, 423 Guardian Drive, Philadelphia, PA, 19104-6021, USA. Michael.smith@pennmedicine.upenn.edu.ORCID 0000-0001-8541-9625
Maryam WitteUnit for Experimental Psychiatry, Division of Sleep and Chronobiology, University of Pennsylvania Perelman School of Medicine, 1017 Blockley Hall, 423 Guardian Drive, Philadelphia, PA, 19104-6021, USA.
Sarah RochaUnit for Experimental Psychiatry, Division of Sleep and Chronobiology, University of Pennsylvania Perelman School of Medicine, 1017 Blockley Hall, 423 Guardian Drive, Philadelphia, PA, 19104-6021, USA.
Mathias BasnerUnit for Experimental Psychiatry, Division of Sleep and Chronobiology, University of Pennsylvania Perelman School of Medicine, 1017 Blockley Hall, 423 Guardian Drive, Philadelphia, PA, 19104-6021, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundQuestionnaires are valuable data collection instruments in public health research, and can serve to pre-screen respondents for suitability in future studies. Survey non-response leads to reduced effective sample sizes and can decrease representativeness of the study population, so high response rates are needed to minimize the risk of bias. Here we present results on the success of different postal questionnaire strategies at effecting response, and the effectiveness of these strategies at recruiting participants for a field study on the effects of aircraft noise on sleep.

methodsIn total, we mailed 17 rounds of 240 questionnaires (total n = 4080) to randomly selected households around Atlanta International Airport. Different mailing rounds were varied in the length of the questionnaire (11, 26 or 55 questions), survey incentive (gift card or $2 cash), number of follow-up waves (0, 2 or 3), incentive for participating in a 5-night in-home sleep study ($100, $150 or $200), and address personalization.

resultsWe received completed questionnaires from 407 respondents (response rate 11.4%). Personalizing the address, enclosing a $2 cash incentive with the initial questionnaire mailing and repeated follow-up mailings were effective at increasing response rate. Despite the increased expense of these approaches in terms of each household mailed, the higher response rates meant that they were more cost-effective overall for obtaining an equivalent number of responses. Interest in participating in the field study decreased with age, but was unaffected by the mailing strategies or cash incentives for field study participation. The likelihood that a respondent would participate in the field study was unaffected by survey incentive, survey length, number of follow-up waves, field study incentive, age or sex.

conclusionsPre-issued cash incentives and sending follow-up waves could maximize the representativeness and numbers of people from which to recruit, and may be an effective strategy for improving recruitment into field studies.

Indexed as

MotivationSurveys and QuestionnairesAdultAircraftCost-Benefit AnalysisFemaleHumansMaleNoisePatient ParticipationPostal ServiceQualitative ResearchSample SizeSleepAircraft noiseCost effectivenessField study recruitmentPostal questionnairesPublic health researchResponse rateSleep disturbance

Identifiers

PMID31805869
PMCPMC6896692

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.