Evidence map›Paper›PMID 35063668›Full record

ArticleJournal of biomedical informatics2022

Fully automated detection of formal thought disorder with Time-series Augmented Representations for Detection of Incoherent Speech (TARDIS).

Weizhe Xu, Weichen Wang, Jake Portanova, Ayesha Chander, Andrew Campbell, Serguei Pakhomov, Dror Ben-Zeev, Trevor Cohen

Open access · greenAbstract read
In one paragraph

Article in Journal of biomedical informatics, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
2.2field-weighted citation impact, top 12% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it, 20 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Parent Psychopathology and Behavioral Effects on Child Brain-Symptom Networks in the ABCD Study.Journal of the American Academy of Child and Adolescent Psychiatry · 2024
    Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 2 institutions in 1 country.

Weizhe XuBiomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States. Electronic address: xuweizhe@uw.edu.
Weichen WangDepartment of Computer Science, Dartmouth College, Hanover, NH, United States.
Jake PortanovaBiomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States.
Ayesha ChanderBehavioral Research in Technology (BRiTE) Center, Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States.
Andrew CampbellDepartment of Computer Science, Dartmouth College, Hanover, NH, United States.
Serguei PakhomovPharmaceutical Care and Health Systems, University of Minnesota, MN, United States.
Dror Ben-ZeevBehavioral Research in Technology (BRiTE) Center, Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States.
Trevor CohenBiomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States; Behavioral Research in Technology (BRiTE) Center, Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States. Electronic address: cohenta@uw.edu.
Dartmouth College · USUniversity of Washington · US

Funding

Mobile RDoC: Using Smartphone Technology to Understand Auditory Verbal HallucinationsR01MH112641 · NIMH · UNIVERSITY OF WASHINGTON · PI BEN-ZEEV, DROR · 2017 to 2020
$2.8M
Computerized assessment of linguistic indicators of lucidity in Alzheimer's Disease dementiaR21AG069792 · NIA · UNIVERSITY OF MINNESOTA · PI MICHALOWSKI, MARTIN, PAKHOMOV, SERGUEI VS · 2020 to 2021
$671k
NIA NIH HHS R21 AG069792NIMH NIH HHS R01 MH112641
6 · The paper itself

Abstract

Formal thought disorder (ThD) is a clinical sign of schizophrenia amongst other serious mental health conditions. ThD can be recognized by observing incoherent speech - speech in which it is difficult to perceive connections between successive utterances and lacks a clear global theme. Automated assessment of the coherence of speech in patients with schizophrenia has been an active area of research for over a decade, in an effort to develop an objective and reliable instrument through which to quantify ThD. However, this work has largely been conducted in controlled settings using structured interviews and depended upon manual transcription services to render audio recordings amenable to computational analysis. In this paper, we present an evaluation of such automated methods in the context of a fully automated system using Automated Speech Recognition (ASR) in place of a manual transcription service, with "audio diaries" collected in naturalistic settings from participants experiencing Auditory Verbal Hallucinations (AVH). We show that performance lost due to ASR errors can often be restored through the application of Time-Series Augmented Representations for Detection of Incoherent Speech (TARDIS), a novel approach that involves treating the sequence of coherence scores from a transcript as a time-series, providing features for machine learning. With ASR, TARDIS improves average AUC across coherence metrics for detection of severe ThD by 0.09; average correlation with human-labeled derailment scores by 0.10; and average correlation between coherence estimates from manual and ASR-derived transcripts by 0.29. In addition, TARDIS improves the agreement between coherence estimates from manual transcripts and human judgment and correlation with self-reported estimates of AVH symptom severity. As such, TARDIS eliminates a fundamental barrier to the deployment of automated methods to detect linguistic indicators of ThD to monitor and improve clinical care in serious mental illness.

Indexed as

SchizophreniaSpeechHallucinationsHumansLinguisticsMachine LearningAuditory Verbal HallucinationAutomatic Speech RecognitionCoherence in SpeechFormal Thought DisorderNatural Language ProcessingNeural Word Embeddings

Identifiers

PMID35063668
PMCPMC8844699
OpenAlexW4206178584

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.