Evidence map›Paper›PMID 39213023›Full record

SynthesisJMIR mental health2024

Evaluation of Digital Mental Health Technologies in the United States: Systematic Literature Review and Framework Synthesis.

Julianna Catania, Steph Beaver, Rakshitha S Kamath, Emma Worthington, Minyi Lu, Hema Gandhi, Heidi C Waters, Daniel C Malone

Abstract readSystematic Review
In one paragraph

Synthesis in JMIR mental health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Feasibility Study of a Novel App-Based Anxiety Intervention for Autistic People.Autism research : official journal of the International Society for Autism Research · 2026
    Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Julianna CataniaCostello Medical, Boston, MA, United States.ORCID 0000-0002-6447-7540
Steph BeaverCostello Medical, Boston, MA, United States.ORCID 0009-0008-7025-8716
Rakshitha S KamathCostello Medical, Boston, MA, United States.ORCID 0009-0002-9935-3975
Emma WorthingtonCostello Medical, Cambridge, United Kingdom.ORCID 0000-0002-2537-6384
Minyi LuOtsuka Pharmaceutical Development & Commercialization Inc, Princeton, NJ, United States.ORCID 0009-0008-2803-177X
Hema GandhiOtsuka Pharmaceutical Development & Commercialization Inc, Princeton, NJ, United States.ORCID 0009-0005-2707-3757
Heidi C WatersOtsuka Pharmaceutical Development & Commercialization Inc, Princeton, NJ, United States.ORCID 0000-0002-5671-3558
Daniel C MaloneDepartment of Pharmacotherapy, Skaggs College of Pharmacy, University of Utah, Salt Lake City, UT, United States.ORCID 0000-0002-5006-9394

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDigital mental health technologies (DMHTs) have the potential to enhance mental health care delivery. However, there is little information on how DMHTs are evaluated and what factors influence their use.

objectiveA systematic literature review was conducted to understand how DMHTs are valued in the United States from user, payer, and employer perspectives.

methodsArticles published after 2017 were identified from MEDLINE, Embase, PsycINFO, Cochrane Library, the Health Technology Assessment Database, and digital and mental health congresses. Each article was evaluated by 2 independent reviewers to identify US studies reporting on factors considered in the evaluation of DMHTs targeting mental health, Alzheimer disease, epilepsy, autism spectrum disorder, or attention-deficit/hyperactivity disorder. Study quality was assessed using the Critical Appraisal Skills Program Qualitative and Cohort Studies Checklists. Studies were coded and indexed using the American Psychiatric Association's Mental Health App Evaluation Framework to extract and synthesize relevant information, and novel themes were added iteratively as identified.

resultsOf the 4353 articles screened, data from 26 unique studies from patient, caregiver, and health care provider perspectives were included. Engagement style was the most reported theme (23/26, 88%), with users valuing DMHT usability, particularly alignment with therapeutic goals through features including anxiety management tools. Key barriers to DMHT use included limited internet access, poor technical literacy, and privacy concerns. Novel findings included the discreetness of DMHTs to avoid stigma.

conclusionsUsability, cost, accessibility, technical considerations, and alignment with therapeutic goals are important to users, although DMHT valuation varies across individuals. DMHT apps should be developed and selected with specific user needs in mind.

Indexed as

Mental Health ServicesDigital TechnologyHumansMental DisordersTechnology Assessment, BiomedicalTelemedicineUnited Statesdigital healthdigital therapeuticsframework synthesismental healthmHealthmixed methodsmobile healthsystematic review

Identifiers

PMID39213023
PMCPMC11399741

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.