Evidence map›Paper›PMID 40826259›Full record

Trial reportAIDS and behavior2025

Comparing Implementation and Effectiveness Outcomes for Two Implementation Strategies of the Keep It Up! Digital HIV Prevention Program: A Type 3 Hybrid Effectiveness-Implementation Trial.

Brian Mustanski, Nanette Benbow, Kathryn Macapagal, Dennis Li, Krystal Madkins, Rana Saber, Benjamin Linas, J D Smith, C Hendricks Brown, Sarah Munroe and 6 more

Registry-linked trialAbstract readComparative StudyPragmatic Clinical TrialRandomized Controlled Trial
In one paragraph

Trial report in AIDS and behavior, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03896776 (A Pragmatic Trial of Two Strategies for Implementing an Effective eHealth HIV Prevention Program), which is not on this map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03896776 nacompletednot on this map

A Pragmatic Trial of Two Strategies for Implementing an Effective eHealth HIV Prevention Program (Keep It Up! 3.0)

TypeinterventionalSponsorNorthwestern UniversityRan2019 to 2023Enrolled2,125ConditionsHIV/AIDS, Gonorrhea, ChlamydiaArmsKeep It Up! 3.0
3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Brian MustanskiImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA. brian@northwestern.edu.ORCID http://orcid.org/0000-0001-9222-5116
Nanette BenbowImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Kathryn MacapagalImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Dennis LiImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Krystal MadkinsImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Rana SaberImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Benjamin LinasSection of Infectious Disease, Boston Medical Center, Boston, MA, USA.
J D SmithDepartment of Population Health Sciences, School of Medicine, The University of Utah, Salt Lake City, UT, USA.
C Hendricks BrownDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.
Sarah MunroeSection of Infectious Disease, Boston Medical Center, Boston, MA, USA.
Susheel ReddyImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Bruce R SchackmanDepartment of Population Health Sciences, Weill Cornell Medical College, Cornell University, New York, NY, USA.
Gregory SwannImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Patrick JanulisImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Alithia ZamantakisImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.
Juan Pablo ZapataImpact Institute, Northwestern University, 625 N. Michigan Ave. Floor 14, Chicago, IL, 60611, USA.

Funding

Virology and Immunology Technology CoreP30AI117943 · NIAID · NORTHWESTERN UNIVERSITY AT CHICAGO · PI Sahera Dirajlal-Fargo · 2015 to 2026
$38.4M
A pragmatic trial of two strategies for implementing an effective eHealth HIV prevention programR01MH118213 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI MUSTANSKI, BRIAN · 2018 to 2022
$8.8M
NIAID NIH HHS P30 AI117943NIMH NIH HHS R01 MH118213
6 · The paper itself

Abstract

This study sought to compare implementation and effectiveness outcomes for two delivery strategies of a digital HIV prevention intervention: community-based organization (CBO) versus direct-to-consumer (DTC). A type III hybrid effectiveness-implementation trial compared two implementation strategies of Keep It Up! (KIU! ) for young men who have sex with men (YMSM) (n = 2124). Data were collected at baseline and 12-weeks in 2019-2023. DTC enrolled more participants, but CBO recruited more Black (11.7% vs. 21.7%) and Latino YMSM (27.3% vs. 32.9%). CBO enrollees were at higher HIV risk based on condomless anal sex (p < .05) and rectal Gonorrhea rates (p < .01). Although pre-exposure prophylaxis (PrEP) use with adherence was 1.94 times higher at follow-up vs. baseline (p < .0001) across arms, PrEP increase was 1.60 times higher in CBO vs. DTC (p < .0001). CBO delivery averted more HIV infections per 100 people-years than DTC (1.65 vs. 0.62), but the cost of averting an HIV infection was higher in CBO than DTC ($983,029 vs. $173,313). Although CBOs were able to reach participants at higher HIV risk, the DTC strategy was estimated to cost less per infection averted and below established thresholds for cost savings. Findings must be interpreted within the context of data collection during the COVID-19 epidemic. More information about KIU! can be found at https://kiu.northwestern.edu/ .Trial registration: NCT03896776 (date of registration: 04/01/2019).

Indexed as

HIV InfectionsHomosexuality, MalePre-Exposure ProphylaxisAdolescentAdultCOVID-19HumansMaleProgram EvaluationSexual and Gender MinoritiesYoung AdultDigital health interventionsHIV/AIDSMen who have sex with menType III hybrid effectiveness implementation trial

Identifiers

PMID40826259
PMCPMC12580418

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.