Evidence map›Paper›PMID 28249833›Full record

ArticleJournal of medical Internet research2017

Costs and Efficiency of Online and Offline Recruitment Methods: A Web-Based Cohort Study.

Tina Christensen, Anders H Riis, Elizabeth E Hatch, Lauren A Wise, Marie G Nielsen, Kenneth J Rothman, Henrik Toft Sørensen, Ellen M Mikkelsen

Abstract readComparative Study
In one paragraph

Article in Journal of medical Internet research, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 58 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
58citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

58 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Article
  12. Article
  13. Article
  14. Observational
  15. Article
  16. Article
  17. Observational
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Tina ChristensenAarhus University Hospital, Department of Clinical Epidemiology, Aarhus N, Denmark.ORCID 0000-0002-3432-7429
Anders H RiisAarhus University Hospital, Department of Clinical Epidemiology, Aarhus N, Denmark.ORCID 0000-0002-6684-4068
Elizabeth E HatchBoston University School of Public Health, Department of Epidemiology, Boston, MA, United States.ORCID 0000-0001-7901-3928
Lauren A WiseBoston University School of Public Health, Department of Epidemiology, Boston, MA, United States.ORCID 0000-0003-2138-3752
Marie G NielsenAarhus University, Research Unit for General Practice, Department of Public Health, Aarhus C, Denmark.ORCID 0000-0001-7048-6294
Kenneth J RothmanBoston University School of Public Health, Department of Epidemiology, Boston, MA, United States.ORCID 0000-0003-2398-1705
Henrik Toft SørensenAarhus University Hospital, Department of Clinical Epidemiology, Aarhus N, Denmark.ORCID 0000-0003-4299-7040
Ellen M MikkelsenAarhus University Hospital, Department of Clinical Epidemiology, Aarhus N, Denmark.ORCID 0000-0003-0158-7950

Funding

An internet based prospective study of time to pregnancyR01HD060680 · NICHD · BOSTON UNIVERSITY MEDICAL CAMPUS · PI HATCH, ELIZABETH E · 2010 to 2014
$2.6M
NICHD NIH HHS R01 HD060680
6 · The paper itself

Abstract

backgroundThe Internet is widely used to conduct research studies on health issues. Many different methods are used to recruit participants for such studies, but little is known about how various recruitment methods compare in terms of efficiency and costs.

objectiveThe aim of our study was to compare online and offline recruitment methods for Internet-based studies in terms of efficiency (number of recruited participants) and costs per participant.

methodsWe employed several online and offline recruitment methods to enroll 18- to 45-year-old women in an Internet-based Danish prospective cohort study on fertility. Offline methods included press releases, posters, and flyers. Online methods comprised advertisements placed on five different websites, including Facebook and Netdoktor.dk. We defined seven categories of mutually exclusive recruitment methods and used electronic tracking via unique Uniform Resource Locator (URL) and self-reported data to identify the recruitment method for each participant. For each method, we calculated the average cost per participant and efficiency, that is, the total number of recruited participants.

resultsWe recruited 8252 study participants. Of these, 534 were excluded as they could not be assigned to a specific recruitment method. The final study population included 7724 participants, of whom 803 (10.4%) were recruited by offline methods, 3985 (51.6%) by online methods, 2382 (30.8%) by online methods not initiated by us, and 554 (7.2%) by other methods. Overall, the average cost per participant was €6.22 for online methods initiated by us versus €9.06 for offline methods. Costs per participant ranged from €2.74 to €105.53 for online methods and from €0 to €67.50 for offline methods. Lowest average costs per participant were for those recruited from Netdoktor.dk (€2.99) and from Facebook (€3.44).

conclusionsIn our Internet-based cohort study, online recruitment methods were superior to offline methods in terms of efficiency (total number of participants enrolled). The average cost per recruited participant was also lower for online than for offline methods, although costs varied greatly among both online and offline recruitment methods. We observed a decrease in the efficiency of some online recruitment methods over time, suggesting that it may be optimal to adopt multiple online methods.

Indexed as

InternetPatient SelectionAdolescentAdultCohort StudiesFemaleHumansMiddle AgedProspective StudiesYoung Adultadvertisingcosts per participantInternetparticipant recruitmentWeb-based study

Identifiers

PMID28249833
PMCPMC5352857

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.