Evidence map›Paper›PMID 30681966›Full record

ArticleJournal of medical Internet research2019

Measuring the Implementation of Behavioral Intervention Technologies: Recharacterization of Established Outcomes.

Eric DA Hermes, Aaron R Lyon, Stephen M Schueller, Joseph E Glass

2 registry-linked trialsAbstract read
In one paragraph

Article in Journal of medical Internet research, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 102 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
102citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05027113 nacompletednot on this mapstarted 2021, after this paper: background citation

App-Based Mindfulness Meditation for People of Color Who Experience Race-Related Stress: A Randomized Control Trial

TypeinterventionalSponsorUniversity of California, Los AngelesRan2021 to 2022Enrolled155ConditionsStress, Psychological, Anxiety, Depression, RuminationArmsMindfulness meditation
NCT05997901 nacompletednot on this mapstarted 2024, after this paper: background citation

Helping People Adhere to Their Varenicline Treatment by Co-creating a Conversational Agent: A Feasibility Study

TypeinterventionalSponsorCentre for Addiction and Mental HealthRan2024 to 2025Enrolled40ConditionsMedication Adherence, Smoking CessationArmsVarenicline healthbot
3 · Its place in the literature

Who cites it

102 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Trial
  9. A Randomized Controlled Trial of a Digital Intervention to Improve the Sexual Health of Adolescent and Young Adult Male Emergency Department Patients.The Journal of adolescent health : official publication of the Society for Adolescent Medicine · 2025
    Trial
  10. A multi-media digital intervention to improve the sexual and reproductive health of female adolescent emergency department patients.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2022
    Trial
  11. Trial
  12. Trial
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article

42 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Eric DA HermesVeterans Affairs Connecticut Healthcare System, West Haven, CT, United States.ORCID 0000-0002-7873-8449
Aaron R LyonDepartment of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States.ORCID 0000-0003-3657-5060
Stephen M SchuellerDepartment of Psychological Science, University of California at Irvine, Irvine, CA, United States.ORCID 0000-0002-1003-0399
Joseph E GlassKaiser Permanente Washington Health Research Institute, Seattle, WA, United States.ORCID 0000-0002-2923-3698

Funding

Decreasing the Engagement Gap for Addiction Treatment in Primary CareK01AA023859 · NIAAA · KAISER FOUNDATION RESEARCH INSTITUTE · PI GLASS, JOSEPH EDWIN · 2017 to 2021
$931k
NIAAA NIH HHS K01 AA023859NIMHD NIH HHS L60 MD009373
6 · The paper itself

Abstract

Behavioral intervention technologies (BITs) are websites, software, mobile apps, and sensors designed to help users address or change behaviors, cognitions, and emotional states. BITs have the potential to transform health care delivery, and early research has produced promising findings of efficacy. BITs also favor new models of health care delivery and provide novel data sources for measurement. However, there are few examples of successful BIT implementation and a lack of consensus on as well as inadequate descriptions of BIT implementation measurement. The aim of this viewpoint paper is to provide an overview and characterization of implementation outcomes for the study of BIT use in routine practice settings. Eight outcomes for the evaluation of implementation have been previously described: acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability. In a proposed recharacterization of these outcomes with respect to BIT implementation, definitions are clarified, expansions to the level of analysis are identified, and unique measurement characteristics are discussed. Differences between BIT development and implementation, an increased focus on consumer-level outcomes, the expansion of providers who support BIT use, and the blending of BITs with traditional health care services are specifically discussed. BITs have the potential to transform health care delivery. Realizing this potential, however, will hinge on high-quality research that consistently and accurately measures how well such technologies have been integrated into health services. This overview and characterization of implementation outcomes support BIT research by identifying and proposing solutions for key theoretical and practical measurement challenges.

Indexed as

Behavior TherapyHumansMobile ApplicationsTechnologyTranslational Research, Biomedicalbehavioral intervention technologybehavior therapydiffusion of innovationimplementationinternetmobile applicationsoutcome assessment (health care)reviewtechnologytelemedicinetranslational medical research

Identifiers

PMID30681966
PMCPMC6367669

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.