Evidence map›Paper›PMID 29661751›Full record

ArticleJMIR research protocols2018

Comparison of Online Survey Recruitment Platforms for Hard-to-Reach Pregnant Smoking Populations: Feasibility Study.

Jose Luis Ibarra, Jessica Marie Agas, Melissa Lee, Julia Lily Pan, Alison Meredith Buttenheim

Abstract read
In one paragraph

Article in JMIR research protocols, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 43 papers.

0numbers the graph read from it
0cells of the map it votes in
43citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

43 citing papers in PubMed.

  1. Trial
  2. Impact of the Terms "American journal of public health · 2019
    Trial
  3. Article
  4. Article
  5. Urban Versus Rural Differences in Services Requested, Received, and Interest Expressed Among Informal Caregivers of Older U.S. Veterans.The Journal of rural health : official journal of the American Rural Health Association and the National Rural Health Care Association · 2026
    Article
  6. Article
  7. Article
  8. Time and Frequency of Social Media Use and Loneliness Among U.S. Adults.International journal of environmental research and public health · 2025
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Associations between posting about alcohol on social networking sites and alcohol-induced blackouts in a sample of young adults not in 4-year college.Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors · 2025
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Jose Luis IbarraDepartment of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States.ORCID http://orcid.org/0000-0002-1991-9872
Jessica Marie AgasDepartment of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States.ORCID http://orcid.org/0000-0002-3156-6993
Melissa LeeDepartment of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States.ORCID http://orcid.org/0000-0003-2333-0953
Julia Lily PanDepartment of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States.ORCID http://orcid.org/0000-0003-2665-8436
Alison Meredith ButtenheimDepartment of Family and Community Health, University of Pennsylvania, Philadelphia, PA, United States.ORCID http://orcid.org/0000-0003-2432-1637

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundRecruiting hard-to-reach populations for health research is challenging. Web-based platforms offer one way to recruit specific samples for research purposes, but little is known about the feasibility of online recruitment and the representativeness and comparability of samples recruited through different Web-based platforms.

objectiveThe objectives of this study were to determine the feasibility of recruiting a hard-to-reach population (pregnant smokers) using 4 different Web-based platforms and to compare participants recruited through each platform.

methodsA screener and survey were distributed online through Qualtrics Panel, Soapbox Sample, Reddit, and Amazon Mechanical Turk (mTurk). Descriptive statistics were used to summarize results of each recruitment platform, including eligibility yield, quality yield, income, race, age, and gestational age.

resultsOf the 3847 participants screened for eligibility across all 4 Web-based platforms, 535 were eligible and 308 completed the survey. Amazon mTurk yielded the fewest completed responses (n=9), 100% (9/9) of which passed several quality metrics verifying pregnancy and smoking status. Qualtrics Panel yielded 14 completed responses, 86% (12/14) of which passed the quality screening. Soapbox Sample produced 107 completed surveys, 67% (72/107) of which were found to be quality responses. Advertising through Reddit produced the highest completion rate (n=178), but only 29.2% (52/178) of those surveys passed the quality metrics. We found significant differences in eligibility yield, quality yield, age, number of previous pregnancies, age of smoking initiation, current smokers, race, education, and income (P<.001).

conclusionsAlthough each platform successfully recruited pregnant smokers, results varied in quality, cost, and percentage of complete responses. Moving forward, investigators should pay careful attention to the percentage yield and cost of online recruitment platforms to maximize internal and external validity.

Indexed as

cognitive biascrowdsourcingdelay discountingnicotinesmokingsocioeconomic statusvulnerable populationsWeb-based methods

Identifiers

PMID29661751
PMCPMC5928332

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.