Evidence map›Paper›PMID 30052702›Full record

ArticleAnnals of behavioral medicine : a publication of the Society of Behavioral Medicine2019

Similarities and Differences in Tobacco Control Research Findings From Convenience and Probability Samples.

Michelle Jeong, Dongyu Zhang, Jennifer C Morgan, Jennifer Cornacchione Ross, Amira Osman, Marcella H Boynton, Jennifer R Mendel, Noel T Brewer

Abstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in Annals of behavioral medicine : a publication of the Society of Behavioral Medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 116 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
116citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

116 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Identifying Healthcare Professionals With Lower Human Papillomavirus (HPV) Vaccine Recommendation Quality: A Systematic Review.The Journal of adolescent health : official publication of the Society for Adolescent Medicine · 2024
    Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Impact of Survey Item Wording and Response Options on Prevalence of Beliefs About Nicotine Causing Cancer: A Randomized Survey Experiment.Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco · 2026
    Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Trial
  14. Trial
  15. Trial
  16. Trial
  17. Effects of Modified Risk Tobacco Product Claims on Consumer Responses.Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco · 2024
    Trial
  18. Trial
  19. Online RCT of Icon Added-Sugar Warning Labels for Restaurant Menus.American journal of preventive medicine · 2023
    Trial
  20. Trial

56 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Michelle JeongDepartment of Health Behavior, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
Dongyu ZhangDepartment of Oncology, Georgetown University School of Medicine, Washington, DC, USA.
Jennifer C MorganDepartment of Health Behavior, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
Jennifer Cornacchione RossWake Forest School of Medicine, Winston-Salem, NC, USA.
Amira OsmanLineberger Comprehensive Cancer Center, University of North Carolina, Chapel Hill, NC, USA.
Marcella H BoyntonDepartment of Health Behavior, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
Jennifer R MendelLineberger Comprehensive Cancer Center, University of North Carolina, Chapel Hill, NC, USA.
Noel T BrewerDepartment of Health Behavior, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.

Funding

Training & Education Program p294-308P50CA180907 · NCI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI RIBISL, KURT M. · 2013 to 2017
$20.2M
NCI NIH HHS P50 CA180907
6 · The paper itself

Abstract

backgroundOnline convenience samples are a quick and low-cost way to study health behavior, but the comparability to findings from probability samples is not yet well understood. PURPOSE: We sought to compare convenience and probability samples' findings for experiments, correlates, and prevalence in the context of tobacco control research.

methodsParticipants were a probability sample of 5,014 U.S. adults recruited by phone from September 2014 through May 2015 (cost ~U.S.$620,000) and an online convenience sample of 4,137 U.S. adults recruited through Amazon Mechanical Turk (MTurk) in December 2014 (cost ~U.S.$17,000). Participants completed a survey with experiments, measures of tobacco product use and demographic characteristics.

resultsMTurk convenience and probability samples showed the same pattern of statistical significance and direction in almost all experiments (21 of 24 analyses did not differ) and observational studies (19 of 25 associations did not differ). Demographic characteristics of the samples differed substantially (1 of 17 estimates did not differ), with the convenience sample being younger, having more years of education, and including more Whites and Asians. Tobacco product use also differed substantially (1 of 22 prevalence estimates did not differ), with the convenience sample reporting more cigarette and e-cigarette use (median error 19%).

conclusionsUsing MTurk convenience samples can yield generalizable findings for experiments and observational studies. Prevalence estimates from MTurk convenience samples are likely to be over- or underestimates.

Indexed as

Epidemiologic MethodsHealth Knowledge, Attitudes, PracticePatient SelectionTobacco SmokingAdolescentAdultFemaleHumansMaleSampling StudiesYoung AdultConvenience samplingHealth behaviorMechanical TurkTobacco controlValidity

Identifiers

PMID30052702
PMCPMC6339836

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.