Evidence map›Paper›PMID 37032952›Full record

ArticleFrontiers in psychiatry2023

A machine learning approach to identifying suicide risk among text-based crisis counseling encounters.

Meghan Broadbent, Mattia Medina Grespan, Katherine Axford, Xinyao Zhang, Vivek Srikumar, Brent Kious, Zac Imel

Open access · goldAbstract read
In one paragraph

Article in Frontiers in psychiatry, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
5.7field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 17 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Logic-driven Indirect Supervision: An Application to Crisis Counseling.Proceedings of the conference. Association for Computational Linguistics. Meeting · 2023
    Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 1 institution in 1 country.

Meghan BroadbentEducational Psychology, The University of Utah, Salt Lake City, UT, United States.
Mattia Medina GrespanKahlert School of Computing, The University of Utah, Salt Lake City, UT, United States.
Katherine AxfordEducational Psychology, The University of Utah, Salt Lake City, UT, United States.
Xinyao ZhangEducational Psychology, The University of Utah, Salt Lake City, UT, United States.
Vivek SrikumarKahlert School of Computing, The University of Utah, Salt Lake City, UT, United States.
Brent KiousDepartment of Psychiatry, The University of Utah, Salt Lake City, UT, United States.
Zac ImelEducational Psychology, The University of Utah, Salt Lake City, UT, United States.
University of Utah · US

Funding

Predicting point-of-care outcomes for text message crisis interventions in teensR21MH135280 · NIMH · UTAH STATE HIGHER EDUCATION SYSTEM--UNIVERSITY OF UTAH · PI KIOUS, BRENT MICHAEL, SRIKUMAR, VIVEK · 2024 to 2025
$403k
NIMH NIH HHS R21 MH135280
6 · The paper itself

Abstract

Introduction: With the increasing utilization of text-based suicide crisis counseling, new means of identifying at risk clients must be explored. Natural language processing (NLP) holds promise for evaluating the content of crisis counseling; here we use a data-driven approach to evaluate NLP methods in identifying client suicide risk. Methods: De-identified crisis counseling data from a regional text-based crisis encounter and mobile tipline application were used to evaluate two modeling approaches in classifying client suicide risk levels. A manual evaluation of model errors and system behavior was conducted. Results: The neural model outperformed a term frequency-inverse document frequency (tf-idf) model in the false-negative rate. While 75% of the neural model's false negative encounters had some discussion of suicidality, 62.5% saw a resolution of the client's initial concerns. Similarly, the neural model detected signals of suicidality in 60.6% of false-positive encounters. Discussion: The neural model demonstrated greater sensitivity in the detection of client suicide risk. A manual assessment of errors and model performance reflected these same findings, detecting higher levels of risk in many of the false-positive encounters and lower levels of risk in many of the false negatives. NLP-based models can detect the suicide risk of text-based crisis encounters from the encounter's content.

Indexed as

crisis text-linemachine learningnatural language processingsuicidetext content

Identifiers

PMID37032952
PMCPMC10076638
OpenAlexW4360618685

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.