Evidence map›Paper›PMID 30138406›Full record

ArticlePloS one2018

A method for achieving high response rates in national surveys of U.S. primary care physicians.

Michaela Brtnikova, Lori A Crane, Mandy A Allison, Laura P Hurley, Brenda L Beaty, Allison Kempe

Abstract read
In one paragraph

Article in PloS one, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 75 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
75citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

75 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Methods to increase response to postal and electronic questionnaires.The Cochrane database of systematic reviews · 2023
    Pooled it
  2. A Brief Educational Intervention to Increase ED Initiation of Buprenorphine for Opioid Use Disorder (OUD).Journal of medical toxicology : official journal of the American College of Medical Toxicology · 2022
    Trial
  3. Trial
  4. Randomized Study of Survey Recruitment Strategies for Parents of Autistic Children.Journal of pediatric health care : official publication of National Association of Pediatric Nurse Associates & Practitioners
    Trial
  5. Article
  6. A Randomized Experiment of Mailed Incentives to Improve Emergency Physician Survey Participation.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. HPV Vaccination Knowledge, Attitudes, and Behaviors Among Clinic Teams in North Texas.Journal of cancer education : the official journal of the American Association for Cancer Education · 2026
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Observational
  17. Article
  18. Article
  19. Article
  20. Article

15 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Michaela BrtnikovaAdult and Child Center for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus and Children's Hospital Colorado, Aurora, CO, United States of America.ORCID 0000-0002-2805-6490
Lori A CraneAdult and Child Center for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus and Children's Hospital Colorado, Aurora, CO, United States of America.
Mandy A AllisonAdult and Child Center for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus and Children's Hospital Colorado, Aurora, CO, United States of America.
Laura P HurleyAdult and Child Center for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus and Children's Hospital Colorado, Aurora, CO, United States of America.
Brenda L BeatyAdult and Child Center for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus and Children's Hospital Colorado, Aurora, CO, United States of America.
Allison KempeAdult and Child Center for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus and Children's Hospital Colorado, Aurora, CO, United States of America.

Funding

Rapid-Cycle Survey Collaborative for Provider Input on Immunization Issues: Vaccine Policy Collaborative InitiativeU01IP001072 · IP · UNIVERSITY OF COLORADO DENVER · PI KEMPE, ALLISON · 2017 to 2019
$1.4M
Rapid-cycle Survey Collaborative for Provider Input on Immunization IssuesU01IP000849 · IP · UNIVERSITY OF COLORADO DENVER · PI KEMPE, ALLISON · 2014 to 2016
$1.3M
NCCDPHP CDC HHS U48 DP001938NCIRD CDC HHS U01 IP000849NCIRD CDC HHS U01 IP001072
6 · The paper itself

Abstract

Physician questionnaires are commonly used in health services research; however, many survey studies are limited by low response rate. We describe the effectiveness of a method to maximize survey response without using incentives, the effectiveness of survey reminders over time, and differences in response rates based on survey mode and primary care specialty. As part of a study to assess vaccine policy issues, 13 separate surveys were conducted by internet and mail over the period of 2008 to 2013. Surveys were conducted among pre-recruited networks of pediatricians, family physicians and general internists. Each network was active for 2 years and responded to 3-6 surveys. Physicians who indicated preference to respond through an online survey received up to 9 e-mailed requests to complete the questionnaire and up to 2 mailed questionnaires. Physicians who chose to respond by mail received up to 3 mailed questionnaires and a reminder postcard. For 6 of the 13 surveys conducted over the 6 year period, an additional mailing using a hand-addressed envelope was mailed to non-responders at the end of the usual protocol. Effectiveness of survey methods was measured by response rates. The overall response rates varied from 66‒83%. Response rates declined 17 percentage-points on average between the first and last surveys administered within each physician network. The internet group consistently had higher response rates than the mail group (74% vs. 62% on average). An additional mailing in a hand-written envelope boosted the final response rate by 11 percentage-points. Self-selection of survey mode, multiple reminders, and hand-written envelopes are effective methods for maximizing response rates in physician surveys.

Indexed as

Physicians, Primary CareSurveys and QuestionnairesAdultElectronic MailHealth Services ResearchHumansMiddle AgedPostal ServiceReminder SystemsUnited States

Identifiers

PMID30138406
PMCPMC6107210

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.