Evidence map›Paper›PMID 29183956›Full record

Trial reportJournal of epidemiology and community health2018

Generalisability of an online randomised controlled trial: an empirical analysis.

Cheng Wang, Katie R Mollan, Michael G Hudgens, Joseph D Tucker, Heping Zheng, Weiming Tang, Li Ling

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of epidemiology and community health, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT02248558 (Crowdsourcing Versus Conventional HIV Testing Promotion), which is not on this map. Cited by 18 papers.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT02248558 nacompletednot on this map

Crowdsourcing Versus Conventional HIV Testing Promotion: A Noninferiority Randomized Controlled Trial to Evaluate Promoting First-Time HIV Testing Among MSM and Transgender Individuals in China

TypeinterventionalSponsorUniversity of North Carolina, Chapel HillRan2014 to 2014Enrolled721ConditionsHIVArmsConventional Video, Crowdsourced Video
3 · Its place in the literature

Who cites it

18 citing papers in PubMed.

  1. Trial
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. The Effect of Wearing a Mask on Facial Attractiveness.Aesthetic surgery journal. Open forum · 2022
    Article
  8. Article
  9. Article
  10. Syphilis Self-testing: A Nationwide Pragmatic Study Among Men Who Have Sex With Men in China.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2020
    Article
  11. Article
  12. Article
  13. Article
  14. Enhancing Public Health Messaging: Discrete-Choice Experiment Evidence on the Design of HIV Testing Messages in China.Medical decision making : an international journal of the Society for Medical Decision Making · 2019
    Article
  15. Article
  16. Article
  17. Article
  18. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Cheng WangFaculty of Medical Statistics and Epidemiology, School of Public Health, Sun Yat-sen University, Guangzhou, China.
Katie R MollanCenter for AIDS Research, School of Medicine, University of North Carolina, Chapel Hill, North Carolina, USA.
Michael G HudgensCenter for AIDS Research, School of Medicine, University of North Carolina, Chapel Hill, North Carolina, USA.
Joseph D TuckerDermatology Hospital of Southern Medical University, Guangzhou, Guangdong, China.
Heping ZhengDermatology Hospital of Southern Medical University, Guangzhou, Guangdong, China.
Weiming TangDermatology Hospital of Southern Medical University, Guangzhou, Guangdong, China.
Li LingFaculty of Medical Statistics and Epidemiology, School of Public Health, Sun Yat-sen University, Guangzhou, China.

Funding

Virology, Immunology, and Microbiology CoreP30AI050410 · NIAID · UNIV OF NORTH CAROLINA CHAPEL HILL · PI DAVID M. MARGOLIS · 2001 to 2026
$76.9M
Re-Entry Supplement: Investigation of Oral Microbial Enzymes for the Detection and Treatment of Periodontal DiseaseUL1TR002489 · NCATS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BUSE, JOHN BERNARD, SHAHEEN, NICHOLAS J · 2018 to 2022
$48.6M
North Carolina Translational & Clinical Sciences Institute (NC TraCS)UL1TR001111 · NCATS · UNIV OF NORTH CAROLINA CHAPEL HILL · PI BUSE, JOHN BERNARD, CAREY, TIMOTHY S · 2013 to 2017
$43.9M
Spurring Innovation in HIV Testing and Linkage: A Crowdsourcing Approach -Diversity SupplementR01AI114310 · NIAID · UNIV OF NORTH CAROLINA CHAPEL HILL · PI TUCKER, JOSEPH DAVID, WEI, CHONGYI · 2014 to 2018
$3.3M
UNC-South China STD Research Training CenterD43TW009532 · FIC · UNIV OF NORTH CAROLINA CHAPEL HILL · PI COHEN, MYRON SCOTT, TUCKER, JOSEPH DAVID · 2013 to 2017
$1.3M
FIC NIH HHS D43 TW009532NCATS NIH HHS UL1 TR001111NCATS NIH HHS UL1 TR002489NIAID NIH HHS P30 AI050410NIAID NIH HHS R01 AI114310
6 · The paper itself

Abstract

backgroundInvestigators increasingly use online methods to recruit participants for randomised controlled trials (RCTs). However, the extent to which participants recruited online represent populations of interest is unknown. We evaluated how generalisable an online RCT sample is to men who have sex with men in China.

methodsInverse probability of sampling weights (IPSW) and the G-formula were used to examine the generalisability of an online RCT using model-based approaches. Online RCT data and national cross-sectional study data from China were analysed to illustrate the process of quantitatively assessing generalisability. The RCT (identifier NCT02248558) randomly assigned participants to a crowdsourced or health marketing video for promotion of HIV testing. The primary outcome was self-reported HIV testing within 4 weeks, with a non-inferiority margin of -3%.

resultsIn the original online RCT analysis, the estimated difference in proportions of HIV tested between the two arms (crowdsourcing and health marketing) was 2.1% (95% CI, -5.4% to 9.7%). The hypothesis that the crowdsourced video was not inferior to the health marketing video to promote HIV testing was not demonstrated. The IPSW and G-formula estimated differences were -2.6% (95% CI, -14.2 to 8.9) and 2.7% (95% CI, -10.7 to 16.2), with both approaches also not establishing non-inferiority.

conclusionsConducting generalisability analysis of an online RCT is feasible. Examining the generalisability of online RCTs is an important step before an intervention is scaled up. TRIAL REGISTRATION NUMBER: NCT02248558.

Indexed as

Homosexuality, MaleInternetPatient SelectionAdolescentAdultAlgorithmsChinaCrowdsourcingEmpirical ResearchHIV InfectionsHumansMaleSelection BiasSelf ReportYoung Adultepidemiological methodshivrandomised trials

Identifiers

PMID29183956
PMCPMC5880638

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.