Evidence map›Paper›PMID 40880164›Full record

ReviewOnline journal of public health informatics2025

Imposters, Bots, and Other Threats to Data Integrity in Online Research: Scoping Review of the Literature and Recommendations for Best Practices.

Isabella B Strickland, Amy K Ferketich, Alayna P Tackett, Joanne G Patterson, Nicholas J K Breitborde, Jade Davis, Megan Roberts

Abstract readReview
In one paragraph

Review in Online journal of public health informatics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Health behaviors among young adult cancer survivors and the importance of task self-efficacy.Journal of cancer survivorship : research and practice · 2026
    Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Isabella B StricklandCollege of Public Health, The Ohio State University, 1841 Neil Ave, Columbus, OH, 43210, United States, 1 6142924647.ORCID http://orcid.org/0009-0007-0348-0600
Amy K FerketichCollege of Public Health, The Ohio State University, 1841 Neil Ave, Columbus, OH, 43210, United States, 1 6142924647.ORCID http://orcid.org/0000-0001-8390-8679
Alayna P TackettCenter for Tobacco Research, The Ohio State University Comprehensive Cancer Center, The Ohio State University, Columbus, OH, United States.ORCID http://orcid.org/0000-0003-3818-141X
Joanne G PattersonCollege of Public Health, The Ohio State University, 1841 Neil Ave, Columbus, OH, 43210, United States, 1 6142924647.ORCID http://orcid.org/0000-0002-3125-2839
Nicholas J K BreitbordePsychiatry and Behavioral Health, College of Medicine, The Ohio State University, Columbus, OH, United States.ORCID http://orcid.org/0000-0002-9877-3719
Jade DavisCollege of Public Health, The Ohio State University, 1841 Neil Ave, Columbus, OH, 43210, United States, 1 6142924647.ORCID http://orcid.org/0009-0002-9490-8222
Megan RobertsCollege of Public Health, The Ohio State University, 1841 Neil Ave, Columbus, OH, 43210, United States, 1 6142924647.ORCID http://orcid.org/0000-0003-4743-2145

Funding

The Ohio State University Tobacco Center of Regulatory Science (OSU-TCORS)U54CA287392 · NCI · OHIO STATE UNIVERSITY · PI Peter G. Shields, Theodore Lee Wagener · 2023 to 2026
$19.5M
NCI NIH HHS U54 CA287392
6 · The paper itself

Abstract

Background: Threats to data integrity have always existed in online human subjects research, but it appears these threats have become more common and more advanced in recent years. Researchers have proposed various techniques to address satisficers, repeat participants, bots, and fraudulent participants; yet, no synthesis of this literature has been conducted. Objective: This study undertakes a scoping review of recent methods and ethical considerations for addressing threats to data integrity in online research. Methods: A PubMed search was used to identify 90 articles published from 2020 to 2024 that were written in English, that discussed online human subjects research, and that had at least one paragraph dedicated to discussing threats to online data integrity. Results: We cataloged 16 types of techniques for addressing threats to online data integrity. Techniques to authenticate personal information (eg, videoconferencing and mailing incentives to a physical address) appear to be very effective at deterring or identifying fraudulent participants. Yet such techniques also come with ethical considerations, including participant burden and increased threats to privacy. Other techniques, such as Completely Automated Public Turing test to tell Computers and Humans Apart (reCAPTCHA; Google LLC), scores, and checking IP addresses, although very common, were also deemed by several researchers as no longer sufficient protections against advanced threats to data integrity. Conclusions: Overall, this review demonstrates the importance of shifting online research protocols as bots and fraudulent participants become more sophisticated.

Indexed as

botsdata integrityfraudonline data collectionPRISMAreview

Identifiers

PMID40880164
PMCPMC12396152

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.