Evidence map›Paper›PMID 35529806›Full record

ArticleProceedings of the ACM on human-computer interaction2022

Involving Crowdworkers with Lived Experience in Content-Development for Push-Based Digital Mental Health Tools: Lessons Learned from Crowdsourcing Mental Health Messages.

Rachel Kornfield, David C Mohr, Rachel Ranney, Emily G Lattie, Jonah Meyerhoff, Joseph J Williams, Madhu Reddy

Abstract read
In one paragraph

Article in Proceedings of the ACM on human-computer interaction, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Framing Helper Therapy to Support User Engagement: Causal Evidence from a Public Deployment of a Mental Health Support Text Messaging Program.Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference · 2026
    Article
  2. Investigating the Role of Situational Disruptors in Engagement with Digital Mental Health Tools.CSCW : proceedings of the Conference on Computer-Supported Cooperative Work. Conference on Computer-Supported Cooperative Work · 2025
    Article
  3. Article
  4. DIS. Designing Interactive Systems (Conference) · 2025
    Article
  5. Article
  6. Article
  7. Investigating the Role of Context in the Delivery of Text Messages for Supporting Psychological Wellbeing.Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference · 2023
    Article
  8. Meeting Users Where They Are: User-centered Design of an Automated Text Messaging Tool to Support the Mental Health of Young Adults.Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference · 2022
    Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Rachel KornfieldNorthwestern University, USA.
David C MohrNorthwestern University, USA.
Rachel RanneyUniversity of California, San Francisco, USA.
Emily G LattieNorthwestern University, USA.
Jonah MeyerhoffNorthwestern University, USA.
Joseph J WilliamsUniversity of Toronto, Canada.
Madhu ReddyUniversity of California, Irvine, USA.

Funding

Northwestern University Clinical and Translational Science Institute (NUCATS)UL1TR001422 · NCATS · NORTHWESTERN UNIVERSITY AT CHICAGO · PI D'AQUILA, RICHARD · 2015 to 2023
$56.8M
Technology Enabled Services for Coordinated Care of Depression in Healthcare SettingsP50MH119029 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI DAVID CURTIS MOHR, Jessica Lee Schleider · 2020 to 2026
$10.7M
Adaptive Messaging to Support Depression Self-ManagementK01MH125172 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI KORNFIELD, RACHEL · 2021 to 2025
$865k
Digital Mental Health Service for Non-Treatment Seeking Young AdultsR34MH124960 · NIMH · NORTHWESTERN UNIVERSITY AT CHICAGO · PI MEYERHOFF, JONAH, MOHR, DAVID CURTIS · 2021 to 2023
$641k
NCATS NIH HHS UL1 TR001422NIMH NIH HHS K01 MH125172NIMH NIH HHS P50 MH119029NIMH NIH HHS R34 MH124960
6 · The paper itself

Abstract

Digital tools can support individuals managing mental health concerns, but delivering sufficiently engaging content is challenging. This paper seeks to clarify how individuals with mental health concerns can contribute content to improve push-based mental health messaging tools. We recruited crowdworkers with mental health symptoms to evaluate and revise expert-composed content for an automated messaging tool, and to generate new topics and messages. A second wave of crowdworkers evaluated expert and crowdsourced content. Crowdworkers generated topics for messages that had not been prioritized by experts, including self-care, positive thinking, inspiration, relaxation, and reassurance. Peer evaluators rated messages written by experts and peers similarly. Our findings also suggest the importance of personalization, particularly when content adaptation occurs over time as users interact with example messages. These findings demonstrate the potential of crowdsourcing for generating diverse and engaging content for push-based tools, and suggest the need to support users in meaningful content customization.

Indexed as

crowdsourcingdigital health interventionsmental healthmixed-methods researchpeer-to-peer supportpersonalization

Identifiers

PMID35529806
PMCPMC9075816

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.