Evidence map›Paper›PMID 37463036›Full record

SynthesisJournal of medical Internet research2023

Scope, Characteristics, Behavior Change Techniques, and Quality of Conversational Agents for Mental Health and Well-Being: Systematic Assessment of Apps.

Xiaowen Lin, Laura Martinengo, Ahmad Ishqi Jabir, Andy Hau Yan Ho, Josip Car, Rifat Atun, Lorainne Tudor Car

Open access · goldAbstract readSystematic Review
In one paragraph

Synthesis in Journal of medical Internet research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
3.9field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it, 20 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 2 institutions in 3 countries.

Xiaowen LinLee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore.ORCID 0000-0001-7497-026X
Laura MartinengoLee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore.ORCID 0000-0003-3539-7207
Ahmad Ishqi JabirLee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore.ORCID 0000-0001-6864-9867
Andy Hau Yan HoPsychology Programme, School of Social Sciences, Nanyang Technological University Singapore, Singapore, Singapore.ORCID 0000-0003-0373-7043
Josip CarCentre for Population Health Sciences, Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore.ORCID 0000-0001-8969-371X
Rifat AtunDepartment of Global Health and Population, Harvard T.H. Chan School of Public Health, Harvard University, Cambridge, MA, United States.ORCID 0000-0002-1531-5983
Lorainne Tudor CarLee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore.ORCID 0000-0001-8414-7664
Nanyang Technological University · SGHarvard University · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundMental disorders cause substantial health-related burden worldwide. Mobile health interventions are increasingly being used to promote mental health and well-being, as they could improve access to treatment and reduce associated costs. Behavior change is an important feature of interventions aimed at improving mental health and well-being. There is a need to discern the active components that can promote behavior change in such interventions and ultimately improve users' mental health.

objectiveThis study systematically identified mental health conversational agents (CAs) currently available in app stores and assessed the behavior change techniques (BCTs) used. We further described their main features, technical aspects, and quality in terms of engagement, functionality, esthetics, and information using the Mobile Application Rating Scale.

methodsThe search, selection, and assessment of apps were adapted from a systematic review methodology and included a search, 2 rounds of selection, and an evaluation following predefined criteria. We conducted a systematic app search of Apple's App Store and Google Play using 42matters. Apps with CAs in English that uploaded or updated from January 2020 and provided interventions aimed at improving mental health and well-being and the assessment or management of mental disorders were tested by at least 2 reviewers. The BCT taxonomy v1, a comprehensive list of 93 BCTs, was used to identify the specific behavior change components in CAs.

resultsWe found 18 app-based mental health CAs. Most CAs had <1000 user ratings on both app stores (12/18, 67%) and targeted several conditions such as stress, anxiety, and depression (13/18, 72%). All CAs addressed >1 mental disorder. Most CAs (14/18, 78%) used cognitive behavioral therapy (CBT). Half (9/18, 50%) of the CAs identified were rule based (ie, only offered predetermined answers) and the other half (9/18, 50%) were artificial intelligence enhanced (ie, included open-ended questions). CAs used 48 different BCTs and included on average 15 (SD 8.77; range 4-30) BCTs. The most common BCTs were 3.3 "Social support (emotional)," 4.1 "Instructions for how to perform a behavior," 11.2 "Reduce negative emotions," and 6.1 "Demonstration of the behavior." One-third (5/14, 36%) of the CAs claiming to be CBT based did not include core CBT concepts.

conclusionsMental health CAs mostly targeted various mental health issues such as stress, anxiety, and depression, reflecting a broad intervention focus. The most common BCTs identified serve to promote the self-management of mental disorders with few therapeutic elements. CA developers should consider the quality of information, user confidentiality, access, and emergency management when designing mental health CAs. Future research should assess the role of artificial intelligence in promoting behavior change within CAs and determine the choice of BCTs in evidence-based psychotherapies to enable systematic, consistent, and transparent development and evaluation of effective digital mental health interventions.

Indexed as

Mobile ApplicationsSelf-ManagementTelemedicineArtificial IntelligenceBehavior TherapyHumansMental Healthappsbehavior changechatbotconversational agentMARSmental healthmHealthMobile Application Rating Scalemobile healthmobile phone

Identifiers

PMID37463036
PMCPMC10394504
OpenAlexW4381430494

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.