Evidence map›Paper›PMID 34463631›Full record

Trial reportJMIR mHealth and uHealth2021

Methods for Authenticating Participants in Fully Web-Based Mobile App Trials from the iReach Project: Cross-sectional Study.

Jodie L Guest, Elizabeth Adam, Iaah L Lucas, Cristian J Chandler, Rebecca Filipowicz, Nicole Luisi, Laura Gravens, Kingsley Leung, Tanaka Chavanduka, Erin E Bonar and 3 more

Open access · goldAbstract readRandomized Controlled Trial
In one paragraph

Trial report in JMIR mHealth and uHealth, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
7.3field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 40 citations in OpenAlex.

  1. Mitigating fraud in a fully decentralized clinical trial of a digital health intervention.Annals of behavioral medicine : a publication of the Society of Behavioral Medicine · 2025
    Trial
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 3 institutions in 1 country.

Jodie L GuestDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0002-3650-3975
Elizabeth AdamDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0002-4061-2971
Iaah L LucasDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0002-0216-9710
Cristian J ChandlerDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0003-1770-4357
Rebecca FilipowiczDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0003-4794-3500
Nicole LuisiDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0003-4466-7141
Laura GravensDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0001-7508-0613
Kingsley LeungDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0001-6446-8524
Tanaka ChavandukaCenter for Sexuality and Health Disparities, University of Michigan, Ann Arbor, MI, United States.ORCID 0000-0003-0167-3867
Erin E BonarCenter for Sexuality and Health Disparities, University of Michigan, Ann Arbor, MI, United States.ORCID 0000-0001-8849-4196
Jose A BauermeisterSchool of Nursing, University of Pennsylvania, Philadelphia, PA, United States.ORCID 0000-0002-9276-2306
Rob StephensonCenter for Sexuality and Health Disparities, University of Michigan, Ann Arbor, MI, United States.ORCID 0000-0002-9239-2640
Patrick S SullivanDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States.ORCID 0000-0002-7728-0587
Emory University · USUniversity of Michigan · USUniversity of Pennsylvania · US

Funding

Virus & Reservoirs CoreP30AI045008 · NIAID · UNIVERSITY OF PENNSYLVANIA · PI Ronald G Collman · 1999 to 2026
$78.6M
Virology and Molecular Biomarkers CoreP30AI050409 · NIAID · EMORY UNIVERSITY · PI Ann M Chahroudi, Colleen F Kelley · 2002 to 2026
$74.0M
Reducing HIV vulnerability through a multilevel life skills intervention for adolescent menU01MD011274 · NIMHD · UNIVERSITY OF PENNSYLVANIA · PI BAUERMEISTER, JOSE ARTURO, STEPHENSON, ROB B. · 2016 to 2020
$9.1M
NIAID NIH HHS P30 AI045008NIAID NIH HHS P30 AI050409NIMHD NIH HHS U01 MD011274
6 · The paper itself

Abstract

backgroundMobile health apps are important interventions that increase the scale and reach of prevention services, including HIV testing and prevention counseling, pre-exposure prophylaxis, condom distribution, and education, of which all are required to decrease HIV incidence rates. The use of these web-based apps as well as fully web-based intervention trials can be challenged by the need to remove fraudulent or duplicate entries and authenticate unique trial participants before randomization to protect the integrity of the sample and trial results. It is critical to ensure that the data collected through this modality are valid and reliable.

objectiveThe aim of this study is to discuss the electronic and manual authentication strategies for the iReach randomized controlled trial that were used to monitor and prevent fraudulent enrollment.

methodsiReach is a randomized controlled trial that focused on same-sex attracted, cisgender males (people assigned male at birth who identify as men) aged 13-18 years in the United States and on enrolling people of color and those in rural communities. The data were evaluated by identifying possible duplications in enrollment, identifying potentially fraudulent or ineligible participants through inconsistencies in the data collected at screening and survey data, and reviewing baseline completion times to avoid enrolling bots and those who did not complete the baseline questionnaire. Electronic systems flagged questionable enrollment. Additional manual reviews included the verification of age, IP addresses, email addresses, social media accounts, and completion times for surveys.

resultsThe electronic and manual strategies, including the integration of social media profiles, resulted in the identification and prevention of 624 cases of potential fraudulent, duplicative, or ineligible enrollment. A total of 79% (493/624) of the potentially fraudulent or ineligible cases were identified through electronic strategies, thereby reducing the burden of manual authentication for most cases. A case study with a scenario, resolution, and authentication strategy response was included.

conclusionsAs web-based trials are becoming more common, methods for handling suspicious enrollments that compromise data quality have become increasingly important for inclusion in protocols. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/10174.

Indexed as

Mobile ApplicationsSocial MediaAdolescentCross-Sectional StudiesData AccuracyHomosexuality, MaleHumansMaleUnited Statesadolescent MSMdata authenticationdata qualityenrollmentfraudHIVmethodsmHealthMSMparticipantspreventionRCTrecruitment

Identifiers

PMID34463631
PMCPMC8441600
OpenAlexW3174265130

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.