Evidence map›Paper›PMID 24446166›Full record

ArticleJournal of medical Internet research2014

Using Google AdWords for international multilingual recruitment to health research websites.

Margaret S Gross, Nancy H Liu, Omar Contreras, Ricardo F Muñoz, Yan Leykin

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed.

  1. Trial
  2. Trial
  3. Baseline Characteristics and Generalizability of Participants in an Internet Smoking Cessation Randomized Trial.Annals of behavioral medicine : a publication of the Society of Behavioral Medicine · 2016
    Trial
  4. Trial
  5. Observational
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Directing the public to evidence-based online content.Journal of the American Medical Informatics Association : JAMIA · 2015
    Article
  17. Article
  18. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Margaret S GrossUniversity of California, San Francisco, CA, United States.
Nancy H Liu
Omar Contreras
Ricardo F Muñoz
Yan Leykin

Funding

Does depression affect quality of decisions to participate in clinical trials?K08MH091501 · NIMH · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI LEYKIN, YAN · 2010 to 2014
$885k
NIMH NIH HHS 5K08MH091501NIMH NIH HHS K08 MH091501
6 · The paper itself

Abstract

backgroundGoogle AdWords, the placement of sponsored links in Google search results, is a potent method of recruitment to Internet-based health studies and interventions. However, the performance of Google AdWords varies considerably depending on the language and the location of the target audience.

objectiveOur goal was to describe differences in AdWords performance when recruiting participants to the same study conducted in four languages and to determine whether AdWords campaigns can be optimized in order to increase recruitment while decreasing costs.

methodsGoogle AdWords were used to recruit participants to the Mood Screener, a multilingual online depression screening tool available in English, Russian, Spanish, and Chinese. Two distinct recruitment periods are described: (1) "Unmanaged", a 6-month period in which ads were allowed to run using only the AdWords tool itself, with no human intervention, and (2) "Managed", a separate 7-week period during which we systematically sought to optimize our recruitment campaigns.

resultsDuring 6 months of unmanaged recruitment, our ads were shown over 1.3 million times, resulting in over 60,000 site visits. The average click-through rate (ratio of ads clicked to ads displayed) varied from 1.86% for Chinese ads to 8.48% for Russian ads, as did the average cost-per-click (from US $0.20 for Chinese ads to US $0.50 for English ads). Although Chinese speakers' click-through rate was lowest, their rate of consenting to participate was the highest, at 3.62%, with English speakers exhibiting the lowest consent rate (0.97%). The conversion cost (cost to recruit a consenting participant) varied from US $10.80 for Russian speakers to US $51.88 for English speakers. During the 7 weeks of "managed" recruitment, we attempted to improve AdWords' performance in regards to the consent rate and cost by systematically deleting underperforming ads and adjusting keywords. We were able to increase the number of people who consent after coming to the site by 91.8% while also decreasing per-consent cost by 23.3%.

conclusionsOur results illustrate the need to linguistically and culturally adapt Google AdWords campaigns and to manage them carefully to ensure the most cost-effective results.

Indexed as

AdvertisingHealth Services ResearchInternetLanguagePatient SelectionDepressionFemaleHumansMaleInternet recruitmentInternet researchmultinationalonlinerecruitment costs

Identifiers

PMID24446166
PMCPMC3906699

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.