Evidence map›Paper›PMID 27637296›Full record

Trial reportJournal of medical Internet research2016

Incentive and Reminder Strategies to Improve Response Rate for Internet-Based Physician Surveys: A Randomized Experiment.

David A Cook, Christopher M Wittich, Wendlyn L Daniels, Colin P West, Ann M Harris, Timothy J Beebe

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of medical Internet research, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03021863 (How Frequently and in What Format Are Research Trial Results Disseminated to Participants? A Survey of Trialists and Response Questionnaire Trial), which is not on this map. Cited by 102 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
102citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03021863 nacompletednot on this mapstarted 2017, after this paper: background citation

How Frequently and in What Format Are Research Trial Results Disseminated to Participants? A Survey of Trialists and Response Questionnaire Trial

TypeinterventionalSponsorThinkWellRan2017 to 2019Enrolled1,198ConditionsMotivationArmsGroup A Reminder, Group B Reminder, Group C Reminder, Group D Reminder, Group E Reminder
3 · Its place in the literature

Who cites it

102 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Methods to increase response to postal and electronic questionnaires.The Cochrane database of systematic reviews · 2023
    Pooled it
  2. Pooled it
  3. A Brief Educational Intervention to Increase ED Initiation of Buprenorphine for Opioid Use Disorder (OUD).Journal of medical toxicology : official journal of the American College of Medical Toxicology · 2022
    Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Utilization of Imaging in Young Athletes with Low Back Pain.International journal of sports physical therapy · 2026
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

42 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

David A CookMayo Clinic Online Learning, Mayo Clinic College of Medicine, Rochester, MN, United States. cook.david33@mayo.edu.ORCID 0000-0003-2383-4633
Christopher M WittichORCID 0000-0003-1371-5139
Wendlyn L DanielsORCID 0000-0001-9079-0437

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundMost research on how to enhance response rates in physician surveys has been done using paper surveys. Uncertainties remain regarding how to enhance response rates in Internet-based surveys.

objectiveTo evaluate the impact of a low-cost nonmonetary incentive and paper mail reminders (formal letter and postcard) on response rates in Internet-based physician surveys.

methodsWe executed a factorial-design randomized experiment while conducting a nationally representative Internet-based physician survey. We invited 3966 physicians (randomly selected from a commercial database of all licensed US physicians) via email to complete an Internet-based survey. We used 2 randomly assigned email messages: one message offered a book upon survey completion, whereas the other did not mention the book but was otherwise identical. All nonrespondents received several email reminders. Some physicians were further assigned at random to receive 1 reminder via paper mail (either a postcard or a letter) or no paper reminder. The primary outcome of this study was the survey response rate.

resultsOf the 3966 physicians who were invited, 451 (11.4%) responded to at least one survey question and 336 (8.5%) completed the entire survey. Of those who were offered a book, 345/2973 (11.6%) responded compared with 106/993 (10.7%) who were not offered a book (odds ratio 1.10, 95% CI 0.87-1.38, P=.42). Regarding the paper mail reminder, 168/1572 (10.7%) letter recipients, 148/1561 (9.5%) postcard recipients, and 69/767 (9.0%) email-only recipients responded (P=.35). The response rate for those receiving letters or postcards was similar (odds ratio 1.14, 95% CI 0.91-1.44, P=.26).

conclusionsOffering a modest nonmonetary incentive and sending a paper reminder did not improve survey response rate. Further research on how to enhance response rates in Internet-based physician surveys is needed.

Indexed as

InternetMotivationReminder SystemsAdultAgedAge FactorsFemaleHumansMaleMiddle AgedPhysiciansResearch DesignSurveys and Questionnairesquestionnaire designsurvey methodssurveys and questionnaires

Identifiers

PMID27637296
PMCPMC5045523

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.