Evidence map›Paper›PMID 41980262›Full record

ArticleJMIR formative research2026

User Experience and Early Clinical Outcomes of a Mental Wellness Chatbot for Depression and Anxiety: Pilot Evaluation Mixed Methods Study.

Scott Graupensperger, Emily J Ward, Graham Baum, Kate H Bentley, Emily R Dworkin, Millard Brown, Adam Chekroud, Matt Hawrilenko

Abstract read
In one paragraph

Article in JMIR formative research, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Scott GraupenspergerSpring Health, 60 Madison Ave, New York, NY, 10010, United States, 1 855-629-0554.ORCID 0000-0002-8655-1190
Emily J WardSpring Health, 60 Madison Ave, New York, NY, 10010, United States, 1 855-629-0554.ORCID 0000-0002-2789-2753
Graham BaumSpring Health, 60 Madison Ave, New York, NY, 10010, United States, 1 855-629-0554.ORCID 0009-0008-5123-5535
Kate H BentleySpring Health, 60 Madison Ave, New York, NY, 10010, United States, 1 855-629-0554.ORCID 0000-0002-6875-6440
Emily R DworkinSpring Health, 60 Madison Ave, New York, NY, 10010, United States, 1 855-629-0554.ORCID 0000-0002-3704-5339
Millard BrownSpring Health, 60 Madison Ave, New York, NY, 10010, United States, 1 855-629-0554.ORCID 0000-0003-2225-9243
Adam ChekroudSpring Health, 60 Madison Ave, New York, NY, 10010, United States, 1 855-629-0554.ORCID 0000-0002-0497-596X
Matt HawrilenkoSpring Health, 60 Madison Ave, New York, NY, 10010, United States, 1 855-629-0554.ORCID 0000-0001-9556-4391

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Artificial intelligence-powered conversational agents (ie, chatbots) are increasingly popular outlets for users seeking psychological support, yet little is known about how users experience early-stage prototypes or which therapeutic processes contribute to clinical improvement. A transparent evaluation of emerging chatbot prototypes is needed to clarify if, how, and why artificial intelligence companions work and to guide their continued development. Objective: This mixed methods pilot study evaluated user experience, acceptability, and preliminary clinical signals for an early-stage mental wellness chatbot. We also examined whether baseline symptom severity moderated clinical improvement. Methods: Three sequential cohorts (n=125) completed a 2-week, incentivized chatbot exposure (approximately 60 min per week). Participants provided first-impression ratings, qualitative feedback, and pre-post assessments of depressive symptoms (PHQ-8 [Patient Health Questionnaire-8]), anxiety symptoms (GAD-7 [Generalized Anxiety Disorder-7]), psychological distress, well-being, and loneliness. Statistical models estimated symptom change and tested interactions with baseline symptom severity. Mixed methods analysis integrated quantitative outcomes with large language model-assisted qualitative content analysis of open-ended responses. Results: Participants described the chatbot as accessible, easy to use, and emotionally validating, while citing limitations in personalization and conversational depth. Qualitative responses consistently highlighted early therapeutic processes such as emotional validation, goal setting, and perceived attunement. Regression models showed significant pre-post reductions in depressive (Hedges g=-0.32) and anxiety (g=-0.32) symptoms, alongside modest improvements in distress and well-being. Baseline severity moderated improvement, with marginal effects indicating larger predicted reductions at higher PHQ-8 and GAD-7 baseline scores (eg, PHQ-8=15: g=-0.84; GAD-7=15: g=-0.62). Conclusions: This pilot provides a comprehensive view of early chatbot development and suggests promising user experiences and preliminary symptom improvements under structured pilot conditions. By integrating experiential and exploratory clinical data, the study identifies candidate process targets to inform ongoing refinement. Findings support continued development and demonstrate procedural feasibility for progression to larger, longer-term trials evaluating engagement and clinical outcomes under more naturalistic conditions.

Indexed as

AnxietyDepressionAdultAgedFemaleHumansMaleMiddle AgedPilot ProjectsPsychological Well-BeingSurveys and QuestionnairesTreatment Outcomeartificial intelligencedigital healthlarge language modelsmental health.therapeutic alliance

Identifiers

PMID41980262
PMCPMC13094381

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.