Evidence map›Paper›PMID 33990615›Full record

ArticleNPJ schizophrenia2021

Natural language processing methods are sensitive to sub-clinical linguistic differences in schizophrenia spectrum disorders.

Sunny X Tang, Reno Kriz, Sunghye Cho, Suh Jung Park, Jenna Harowitz, Raquel E Gur, Mahendra T Bhati, Daniel H Wolf, João Sedoc, Mark Y Liberman

Registry-linked trialOpen access · goldAbstract read
In one paragraph

Article in NPJ schizophrenia, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06978803 (HYEEG Discourse in Psychosis), which is not on this map. Cited by 58 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
58citing papers in PubMed, 2 pooled it
13.0field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06978803 recruitingnot on this mapstarted 2024, after this paper: background citation

HYEEG Discourse in Psychosis: A Neurobehavioural Study

TypeobservationalSponsorDouglas Mental Health University InstituteRan2024 to 2026Enrolled110ConditionsPsychosis, Schizophrenia Disorders
3 · Its place in the literature

Who cites it

58 citing papers in PubMed, 2 syntheses or guidelines pooled it, 120 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Structural neuroimaging correlates of semantic incoherence in schizophrenia.European archives of psychiatry and clinical neuroscience · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 3 institutions in 1 country.

Sunny X TangZucker Hillside Hospital, Department of Psychiatry, 75-59 263rd St., Glen Oaks, NY, USA. Stang3@northwell.edu.ORCID http://orcid.org/0000-0002-4001-8120
Reno Kriz *University of Pennsylvania, Department of Computer Science, 3330 Walnut St, Levine Hall, Philadelphia, PA, USA.
Sunghye Cho *Linguistics Data Consortium, 3600 Market St, Suite 810, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0003-1569-7608
Suh Jung ParkUniversity of Pennsylvania, Department of Psychiatry, 3400 Spruce St, Gates Building, Philadelphia, PA, USA.
Jenna HarowitzUniversity of Pennsylvania, Department of Psychiatry, 3400 Spruce St, Gates Building, Philadelphia, PA, USA.
Raquel E GurUniversity of Pennsylvania, Department of Psychiatry, 3400 Spruce St, Gates Building, Philadelphia, PA, USA.
Mahendra T BhatiUniversity of Pennsylvania, Department of Psychiatry, 3400 Spruce St, Gates Building, Philadelphia, PA, USA.
Daniel H WolfUniversity of Pennsylvania, Department of Psychiatry, 3400 Spruce St, Gates Building, Philadelphia, PA, USA.
João SedocNew York University, Department of Technology, Operations, and Statistics, 44 West Fourth Street, Kaufman Management Center, New York, NY, USA.
Mark Y LibermanLinguistics Data Consortium, 3600 Market St, Suite 810, Philadelphia, PA, USA.
University of Pennsylvania · USClinical Research Consortium · USNew York University · US

Funding

ZDV VS ZDV + DDL VS ZDV + DDL + NVP IN ASYMPTOMATIC HIV PATIENTSM01RR000040 · NCRR · UNIVERSITY OF PENNSYLVANIA · PI FITZGERALD, GARRET A · 1985 to 2006
$21.1M
SCHIZOPHRENIA: A NEUROPSYCHIATRIC PERSPECTIVET32MH019112 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI GUR, RAQUEL E · 1990 to 2024
$6.2M
Evolution of Psychosis in Youth: Multimodal Risk and Resilience MarkersR01MH119219 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI GUR, RAQUEL E, GUR, RUBEN C. · 2019 to 2023
$3.8M
Word Encoding and Recognition in SchizophreniaR01MH062103 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI RAGLAND, JOHN D · 2002 to 2005
$832k
2016 SETAC Asia/Pacific ConferenceR13ES027302 · NIEHS · SOCIETY/ENVIRONMENTAL TOXICOLOGY/CHEM · PI MENZIE, CHARLES · 2016 to 2016
$6k
NCRR NIH HHS M01 RR000040NIEHS NIH HHS 27302C0115NIMH NIH HHS R01 MH062103NIMH NIH HHS R01 MH119219NIMH NIH HHS T32 MH019112United States Department of Defense | Defense Advanced Research Projects Agency (DARPA) HR0011-15-C-0115U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (NIMH) M01RR0040U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (NIMH) MH-62103
6 · The paper itself

Abstract

Computerized natural language processing (NLP) allows for objective and sensitive detection of speech disturbance, a hallmark of schizophrenia spectrum disorders (SSD). We explored several methods for characterizing speech changes in SSD (n = 20) compared to healthy control (HC) participants (n = 11) and approached linguistic phenotyping on three levels: individual words, parts-of-speech (POS), and sentence-level coherence. NLP features were compared with a clinical gold standard, the Scale for the Assessment of Thought, Language and Communication (TLC). We utilized Bidirectional Encoder Representations from Transformers (BERT), a state-of-the-art embedding algorithm incorporating bidirectional context. Through the POS approach, we found that SSD used more pronouns but fewer adverbs, adjectives, and determiners (e.g., "the," "a,"). Analysis of individual word usage was notable for more frequent use of first-person singular pronouns among individuals with SSD and first-person plural pronouns among HC. There was a striking increase in incomplete words among SSD. Sentence-level analysis using BERT reflected increased tangentiality among SSD with greater sentence embedding distances. The SSD sample had low speech disturbance on average and there was no difference in group means for TLC scores. However, NLP measures of language disturbance appear to be sensitive to these subclinical differences and showed greater ability to discriminate between HC and SSD than a model based on clinical ratings alone. These intriguing exploratory results from a small sample prompt further inquiry into NLP methods for characterizing language disturbance in SSD and suggest that NLP measures may yield clinically relevant and informative biomarkers.

Identifiers

PMID33990615
PMCPMC8121795
OpenAlexW3161283304

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.