Evidence map›Paper›PMID 31250195›Full record

ReviewCurrent HIV/AIDS reports2019

Design Considerations for Implementing eHealth Behavioral Interventions for HIV Prevention in Evolving Sociotechnical Landscapes.

Dennis H Li, C Hendricks Brown, Carlos Gallo, Ethan Morgan, Patrick S Sullivan, Sean D Young, Brian Mustanski

Open access · greenAbstract readReview
In one paragraph

Review in Current HIV/AIDS reports, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed
7.7field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 37 citations in OpenAlex.

  1. Effectiveness of the smart program: Stepped-care HIV prevention for gay and bisexual adolescent boys.Health psychology : official journal of the Division of Health Psychology, American Psychological Association · 2025
    Trial
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 3 institutions in 1 country.

Dennis H LiInstitute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, Chicago, IL, USA. dennis@northwestern.edu.
C Hendricks BrownCenter for Prevention Implementation Methodology for Drug Abuse and HIV, Northwestern University, Chicago, IL, USA.
Carlos GalloCenter for Prevention Implementation Methodology for Drug Abuse and HIV, Northwestern University, Chicago, IL, USA.
Ethan MorganInstitute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, Chicago, IL, USA.
Patrick S SullivanDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, USA.
Sean D YoungInstitute for Prediction Technology, Department of Informatics, Bren School of Information and Computer Science, University of California, Irvine, Irvine, CA, USA.
Brian MustanskiInstitute for Sexual and Gender Minority Health and Wellbeing, Northwestern University, Chicago, IL, USA.
Northwestern University · USEmory University · USUniversity of California, Irvine · US

Funding

Virology and Molecular Biomarkers CoreP30AI050409 · NIAID · EMORY UNIVERSITY · PI Ann M Chahroudi, Colleen F Kelley · 2002 to 2026
$74.0M
Virology CoreP30AI028697 · NIAID · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI MITSUYASU, RONALD T. · 1991 to 2018
$39.9M
Virology and Immunology Technology CoreP30AI117943 · NIAID · NORTHWESTERN UNIVERSITY AT CHICAGO · PI Mohamed Abdel Mohsen · 2015 to 2026
$38.4M
INNOVATIVE IMPLEMENTATION RESEARCH METHODS COREP30DA027828 · NIDA · UNIVERSITY OF MIAMI SCHOOL OF MEDICINE · PI BROWN, C. HENDRICKS, MUSTANSKI, BRIAN · 2011 to 2020
$11.4M
A pragmatic trial of two strategies for implementing an effective eHealth HIV prevention programR01MH118213 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI MUSTANSKI, BRIAN · 2018 to 2022
$8.8M
Theoretically Based Mobile App to Increase PrEP Uptake Among MSMR01DA045612 · NIDA · EMORY UNIVERSITY · PI SULLIVAN, PATRICK SEAN · 2017 to 2021
$5.2M
Efficacy of Internet-based HIV preventionR01DA035145 · NIDA · NORTHWESTERN UNIVERSITY AT CHICAGO · PI MUSTANSKI, BRIAN · 2012 to 2016
$3.7M
Mining real-time social media big data to monitor HIV: Development and Ethical IssuesR01AI132030 · NIAID · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI YOUNG, SEAN · 2017 to 2020
$3.4M
HOPE Social Media Intervention for HIV Testing and Studying Social NetworksR01MH106415 · NIMH · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI YOUNG, SEAN · 2015 to 2019
$2.9M
Harnessing the power of text messaging to invigorate AMSM HIV preventive behaviorR01MH096660 · NIMH · CENTER FOR INNOVATIVE PUBLIC HEALTH RESEARCH · PI MUSTANSKI, BRIAN, YBARRA, MICHELE L. · 2012 to 2014
$1.6M
Using online social networks for HIV prevention in African American/Latino MSMK01MH090884 · NIMH · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI YOUNG, SEAN · 2010 to 2014
$842k
Internet-Based HIV/STI Prevention for Young MSM Receiving HIV TestingR34MH079714 · NIMH · UNIVERSITY OF ILLINOIS AT CHICAGO · PI MUSTANSKI, BRIAN · 2007 to 2009
$693k
NIAID NIH HHS P30 AI028697NIAID NIH HHS P30 AI050409NIAID NIH HHS P30 AI117943NIAID NIH HHS R01 AI132030NIDA NIH HHS F32 DA046313NIDA NIH HHS P30 DA027828NIDA NIH HHS R01 DA035145NIDA NIH HHS R01 DA045612NIMH NIH HHS K01 MH090884NIMH NIH HHS R01 MH096660NIMH NIH HHS R01 MH106415NIMH NIH HHS R01 MH118213NIMH NIH HHS R34 MH079714
6 · The paper itself

Abstract

purpose of reviewDespite tremendous potential for public health impact and continued investments in development and evaluation, it is rare for eHealth behavioral interventions to be implemented broadly in practice. Intervention developers may not be planning for implementation when designing technology-enabled interventions, thus creating greater challenges for real-world deployment following a research trial. To facilitate faster translation to practice, we aimed to provide researchers and developers with an implementation-focused approach and set of design considerations as they develop new eHealth programs. RECENT

findingsUsing the Accelerated Creation-to-Sustainment model as a lens, we examined challenges and successes experienced during the development and evaluation of four diverse eHealth HIV prevention programs for young men who have sex with men: Keep It Up!, Harnessing Online Peer Education, Guy2Guy, and HealthMindr. HIV is useful for studying eHealth implementation because of the substantial proliferation of diverse eHealth interventions with strong evidence of reach and efficacy and the responsiveness to rapid and radical disruptions in the field. Rather than locked-down products to be disseminated, eHealth interventions are complex sociotechnical systems that require continual optimization, vigilance to monitor and troubleshoot technological issues, and decision rules to refresh content and functionality while maintaining fidelity to core intervention principles. Platform choice and sociotechnical relationships (among end users, implementers, and the technology) heavily influence implementation needs and challenges. We present a checklist of critical implementation questions to address during intervention development. In the absence of a clear path forward for eHealth implementation, deliberate design of an eHealth intervention's service and technological components in tandem with their implementation plans is critical to mitigating barriers to widespread use. The design considerations presented can be used by developers, evaluators, reviewers, and funders to prioritize the pragmatic scalability of eHealth interventions in research.

Indexed as

CommunicationBehavior TherapyHIV InfectionsHomosexuality, MaleHumansMaleSexual and Gender MinoritiesTelemedicineeHealthHIVImplementationIntervention developmentmHealthScalabilitySustainabilityYoung men who have sex with men

Identifiers

PMID31250195
PMCPMC6837839
OpenAlexW2956094009

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.