Evidence map›Paper›PMID 34081011›Full record

ArticleJMIR formative research2021

Expanding the Reach of Research: Quantitative Evaluation of a Web-Based Approach for Remote Recruitment of People Who Hear Voices.

Benjamin Buck, Ayesha Chander, Rachel M Brian, Weichen Wang, Andrew T Campbell, Dror Ben-Zeev

Open access · goldAbstract read
In one paragraph

Article in JMIR formative research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
0.5field-weighted citation impact, top 40% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 5 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Benjamin BuckBehavioral Research in Technology and Engineering (BRiTE) Center, Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0003-2841-0493
Ayesha ChanderBehavioral Research in Technology and Engineering (BRiTE) Center, Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0001-9710-8883
Rachel M BrianBehavioral Research in Technology and Engineering (BRiTE) Center, Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0003-4220-7280
Weichen WangDepartment of Computer Science, Dartmouth College, Hanover, NH, United States.ORCID https://orcid.org/0000-0001-6738-9944
Andrew T CampbellDepartment of Computer Science, Dartmouth College, Hanover, NH, United States.ORCID https://orcid.org/0000-0001-7394-7682
Dror Ben-ZeevBehavioral Research in Technology and Engineering (BRiTE) Center, Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States.ORCID https://orcid.org/0000-0001-6597-2407
University of Washington · USDartmouth College · US

Funding

Mobile RDoC: Using Smartphone Technology to Understand Auditory Verbal HallucinationsR01MH112641 · NIMH · UNIVERSITY OF WASHINGTON · PI BEN-ZEEV, DROR · 2017 to 2020
$2.8M
User-centered design of a mobile health intervention to promote help-seeking and reduce duration of untreated illness among young adults with early psychosisK23MH122504 · NIMH · UNIVERSITY OF WASHINGTON · PI BUCK, BENJAMIN EDWARDS · 2020 to 2024
$930k
NIMH NIH HHS K23 MH122504NIMH NIH HHS R01 MH112641
6 · The paper itself

Abstract

backgroundSimilar to other populations with highly stigmatized medical or psychiatric conditions, people who hear voices (ie, experience auditory verbal hallucinations [AVH]) are often difficult to identify and reach for research. Technology-assisted remote research strategies reduce barriers to research recruitment; however, few studies have reported on the efficiency and effectiveness of these approaches.

objectiveThis study introduces and evaluates the efficacy of technology-assisted remote research designed for people who experience AVH.

methodsOur group developed an integrated, automated and human complementary web-based recruitment and enrollment apparatus that incorporated Google Ads, web-based screening, identification verification, hybrid automation, and interaction with live staff. We examined the efficacy of that apparatus by examining the number of web-based advertisement impressions (ie, number of times the web-based advertisement was viewed); clicks on that advertisement; engagement with web-based research materials; and the extent to which it succeeded in representing a broad sample of individuals with AVH, assessed through the self-reported AVH symptom severity and demographic representativeness (relative to the US population) of the sample recruited.

resultsOver an 18-month period, our Google Ads advertisement was viewed 872,496 times and clicked on 11,183 times. A total amount of US $4429.25 was spent on Google Ads, resulting in 772 individuals who experience AVH providing consent to participate in an entirely remote research study (US $0.40 per click on the advertisement and US $5.73 per consented participant) after verifying their phone number, passing a competency screening questionnaire, and providing consent. These participants reported high levels of AVH frequency (666/756, 88.1% daily or more), distress (689/755, 91.3%), and functional interference (697/755, 92.4%). They also represented a broad sample of diversity that mirrored the US population demographics. Approximately one-third (264/756, 34.9%) of the participants had never received treatment for their AVH and, therefore, were unlikely to be identified via traditional clinic-based research recruitment strategies.

conclusionsWeb-based procedures allow for time saving, cost-efficient, and representative recruitment of individuals with AVH and can serve as a model for future studies focusing on hard-to-reach populations.

Indexed as

digital healthmobile phonerecruitmentresearch procedures

Identifiers

PMID34081011
PMCPMC8212619
OpenAlexW3153412779

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.