Evidence map›Paper›PMID 40627620›Full record

ArticlePloS one2025

Assessing self-selection biases in Facebook-recruited online surveys: Evidence from the COVID-19 Health Behavior Survey.

Jessica Donzowa, Daniela Perrotta, Emilio Zagheni

Abstract read
In one paragraph

Article in PloS one, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Jessica DonzowaDepartment of Digital and Computational Demography, Max Planck Institute for Demographic Research, Rostock, Mecklenburg Western Pomerania, Germany.ORCID https://orcid.org/0009-0007-4173-6195
Daniela PerrottaDepartment of Digital and Computational Demography, Max Planck Institute for Demographic Research, Rostock, Mecklenburg Western Pomerania, Germany.
Emilio ZagheniDepartment of Digital and Computational Demography, Max Planck Institute for Demographic Research, Rostock, Mecklenburg Western Pomerania, Germany.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

During the COVID-19 pandemic, many primary data collection efforts relied on online surveys via social media recruitment. According to the leverage-salience theory, respondents' varying interest in the survey topic can lead to differential survey responses, potentially introducing biases. In this study, we investigate the potential impact of displaying the survey topic in the survey recruitment materials on survey responses. We use data from the "COVID-19 Health Behavior Survey", a cross-national online survey that we ran between March and August 2020 in eight countries in Europe and North America (N=120,184). Respondents were recruited via targeted advertisements placed on Facebook with varying degrees of reference to the survey topic of COVID-19. The aim of our study is to assess whether stronger (or weaker) topic salience in the ad images is associated with higher (or lower) threat perceptions of COVID-19 and the adoption of preventive behaviors, including face mask use and increased hand-washing. Regression analyses show that in 20 of the 32 models, ad images had no significant effect on the survey outcomes. Factors like the month of survey participation or respondents' age were more influential. In the remaining models, where unexplained image effects persisted, the impact was minimal. While mask-wearing images were generally associated with lower threat perceptions of COVID-19 to oneself and the family, we found no consistent pattern for the adoption of protective behaviors. Overall, our findings do not provide consistent evidence that higher topic salience in our Facebook-based recruitment materials systematically influenced survey responses. However, in specific countries, certain recruitment images were linked to variations in COVID-19 threat perception and uptake of preventive behaviors. These context-specific effects highlight the importance of careful recruitment design for Facebook-based surveys during health crises.

Indexed as

COVID-19Health BehaviorHealth SurveysSocial MediaAdolescentAdultAgedEuropeFemaleHumansMaleMiddle AgedNorth AmericaPandemicsSARS-CoV-2Selection Bias

Identifiers

PMID40627620
PMCPMC12237053

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.