Evidence map›Paper›PMID 31026595›Full record

ArticleJournal of biomedical informatics2019

A multi-faceted approach to characterizing user behavior and experience in a digital mental health intervention.

Annie T Chen, Shuyang Wu, Kathryn N Tomasino, Emily G Lattie, David C Mohr

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Observational
  18. Article
  19. Review
  20. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Annie T ChenBiomedical Informatics and Medical Education, UW Medicine South Lake Union, 850 Republican Street, Box 358047, Seattle, WA 98109, United States. Electronic address: atchen@uw.edu.
Shuyang WuBiomedical Informatics and Medical Education, UW Medicine South Lake Union, 850 Republican Street, Box 358047, Seattle, WA 98109, United States; Veracyte, Inc., 6000 Shoreline Ct., Suite 300, South San Francisco, CA 94080, United States. Electronic address: sw21@uw.edu.
Kathryn N TomasinoCenter for Behavioral Intervention Technologies, Northwestern University, 750 N Lake Shore Dr, 10th Fl, Chicago, IL 60611, United States; Department of Medicine, Northwestern University Feinberg School of Medicine, 420 E Superior St, Chicago, IL 60611, United States. Electronic address: Kathryn.Tomasino@nm.org.
Emily G LattieCenter for Behavioral Intervention Technologies, Northwestern University, 750 N Lake Shore Dr, 10th Fl, Chicago, IL 60611, United States. Electronic address: emily.lattie@northwestern.edu.
David C MohrCenter for Behavioral Intervention Technologies, Northwestern University, 750 N Lake Shore Dr, 10th Fl, Chicago, IL 60611, United States. Electronic address: d-mohr@northwestern.edu.

Funding

Northwestern University Clinical and Translational Science Institute (NUCATS)UL1TR001422 · NCATS · NORTHWESTERN UNIVERSITY AT CHICAGO · PI D'AQUILA, RICHARD · 2015 to 2023
$56.8M
Technology Enabled Services for Coordinated Care of Depression in Healthcare SettingsP50MH119029 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI DAVID CURTIS MOHR · 2020 to 2026
$10.7M
Artificial Intelligence in a Mobile Intervention for Depression (AIM)R01MH100482 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI MOHR, DAVID CURTIS · 2013 to 2017
$3.1M
Expanding College Student Mental Health with Stress Management Mobile TechnologiesK08MH112878 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI LATTIE, EMILY GARDINER · 2017 to 2021
$746k
NCATS NIH HHS UL1 TR001422NIMH NIH HHS K08 MH112878NIMH NIH HHS P50 MH119029NIMH NIH HHS R01 MH100482
6 · The paper itself

Abstract

Digital interventions offer great promise for supporting health-related behavior change. However, there is much that we have yet to learn about how people respond to them. In this study, we present a novel mixed-methods approach to analysis of the complex and rich data that digital interventions collect. We perform secondary analysis of IntelliCare, an intervention in which participants are able to try 14 different mental health apps over the course of eight weeks. The goal of our analysis is to characterize users' app use behavior and experiences, and is rooted in theoretical conceptualizations of engagement as both usage and user experience. In the first aim, we employ cluster analysis to identify subgroups of participants that share similarities in terms of the frequency of their usage of particular apps, and then employ other engagement measures to compare the clusters. We identified four clusters with different app usage patterns: Low Usage, High Usage, Daily Feats Users, and Day to Day users. Each cluster was distinguished by its overall frequency of app use, or the main app that participants used. In the second aim, we developed a computer-assisted text analysis and visualization method - message highlighting - to facilitate comparison of the clusters. Last, we performed a qualitative analysis using participant messages to better understand the mechanisms of change and usability of salient apps from the cluster analysis. Our novel approach, integrating text and visual analytics with more traditional qualitative analysis techniques, can be used to generate insights concerning the behavior and experience of users in digital health contexts, for subsequent personalization and to identify areas for improvement of intervention technologies.

Indexed as

Attitude to ComputersTelemedicineHumansMental DisordersMental HealthMobile ApplicationsAnxietyDepressionDigital interventionsEngagementLog dataVisualization

Identifiers

PMID31026595
PMCPMC6662914

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.