Evidence map›Paper›PMID 34963643›Full record

Observational studyJournal of affective disorders2022

The relationship between text message sentiment and self-reported depression.

Tony Liu, Jonah Meyerhoff, Johannes C Eichstaedt, Chris J Karr, Susan M Kaiser, Konrad P Kording, David C Mohr, Lyle H Ungar

Abstract readObservational Study
In one paragraph

Observational study in Journal of affective disorders, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 34 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Comparing training window selection methods for prediction in non-stationary time series.The British journal of mathematical and statistical psychology · 2026
    Article
  6. Article
  7. Observational
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Mental Health and Mobile Communication Profiles of Crowdsourced Participants.IEEE journal of biomedical and health informatics · 2024
    Article
  15. Beyond Detection: Towards Actionable Sensing Research in Clinical Mental Healthcare.Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies · 2024
    Article
  16. Observational
  17. Language sentiment predicts changes in depressive symptoms.Proceedings of the National Academy of Sciences of the United States of America · 2024
    Article
  18. Detecting adolescent depression through passive monitoring of linguistic markers in smartphone communication.Journal of child psychology and psychiatry, and allied disciplines · 2024
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Tony LiuDepartment of Computer and Information Science, University of Pennsylvania, USA. Electronic address: liutony@seas.upenn.edu.
Jonah MeyerhoffCenter for Behavioral Intervention Technologies (CBITs), Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, USA.
Johannes C EichstaedtDepartment of Psychology, Stanford University, USA.
Chris J KarrAudacious Software, USA.
Susan M KaiserCenter for Behavioral Intervention Technologies (CBITs), Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, USA.
Konrad P KordingDepartment of Bioengineering, Department of Neuroscience, University of Pennsylvania, USA.
David C MohrCenter for Behavioral Intervention Technologies (CBITs), Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, USA.
Lyle H UngarDepartment of Computer and Information Science, University of Pennsylvania, USA.

Funding

Northwestern University Clinical and Translational Science Institute (NUCATS)UL1TR001422 · NCATS · NORTHWESTERN UNIVERSITY AT CHICAGO · PI D'AQUILA, RICHARD · 2015 to 2023
$56.8M
Technology Enabled Services for Coordinated Care of Depression in Healthcare SettingsP50MH119029 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI Rachel Kornfield · 2020 to 2026
$10.7M
LifeSense: Transforming Behavioral Assessment of Depression Using Personal Sensing TechnologyR01MH111610 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI KORDING, KONRAD P., MOHR, DAVID CURTIS · 2017 to 2020
$3.2M
Multidisciplinary Training Program in Digital Mental HealthT32MH115882 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI Darren Gergle, DAVID CURTIS MOHR · 2018 to 2026
$2.4M
NCATS NIH HHS UL1 TR001422NIMH NIH HHS P50 MH119029NIMH NIH HHS R01 MH111610NIMH NIH HHS T32 MH115882
6 · The paper itself

Abstract

backgroundPersonal sensing has shown promise for detecting behavioral correlates of depression, but there is little work examining personal sensing of cognitive and affective states. Digital language, particularly through personal text messages, is one source that can measure these markers.

methodsWe correlated privacy-preserving sentiment analysis of text messages with self-reported depression symptom severity. We enrolled 219 U.S. adults in a 16 week longitudinal observational study. Participants installed a personal sensing app on their phones, which administered self-report PHQ-8 assessments of their depression severity, collected phone sensor data, and computed anonymized language sentiment scores from their text messages. We also trained machine learning models for predicting end-of-study self-reported depression status using on blocks of phone sensor and text features.

resultsIn correlation analyses, we find that degrees of depression, emotional, and personal pronoun language categories correlate most strongly with self-reported depression, validating prior literature. Our classification models which predict binary depression status achieve a leave-one-out AUC of 0.72 when only considering text features and 0.76 when combining text with other networked smartphone sensors. LIMITATIONS: Participants were recruited from a panel that over-represented women, caucasians, and individuals with self-reported depression at baseline. As language use differs across demographic factors, generalizability beyond this population may be limited. The study period also coincided with the initial COVID-19 outbreak in the United States, which may have affected smartphone sensor data quality.

conclusionsEffective depression prediction through text message sentiment, especially when combined with other personal sensors, could enable comprehensive mental health monitoring and intervention.

Indexed as

COVID-19Text MessagingAdultAttitudeDepressionFemaleHumansSARS-CoV-2Self ReportDepressionDigital phenotypingLanguage sentiment analysisMachine learningPersonal sensing

Identifiers

PMID34963643
PMCPMC8912980

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.