Evidence map›Paper›PMID 32464070›Full record

ArticleJournal of speech, language, and hearing research : JSLHR2020

Automation of the Northwestern Narrative Language Analysis System.

Davida Fromm, Brian MacWhinney, Cynthia K Thompson

Open access · greenAbstract read
In one paragraph

Article in Journal of speech, language, and hearing research : JSLHR, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
1.2field-weighted citation impact, top 16% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 19 citations in OpenAlex.

  1. Characterizing Verb Argument Structure in Aphasia Using Dependency Parsers.Journal of speech, language, and hearing research : JSLHR · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. Automation of Language Sample Analysis.Journal of speech, language, and hearing research : JSLHR · 2023
    Article
  6. Treatment-induced neural reorganization in aphasia is language-domain specific: Evidence from a large-scale fMRI study.Cortex; a journal devoted to the study of the nervous system and behavior · 2023
    Article
  7. Article
  8. Article
  9. A Comparison of Manual Versus Automated Quantitative Production Analysis of Connected Speech.Journal of speech, language, and hearing research : JSLHR · 2021
    Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 2 institutions in 1 country.

Davida FrommDepartment of Psychology, Carnegie Mellon University, Pittsburgh, PA.
Brian MacWhinneyDepartment of Psychology, Carnegie Mellon University, Pittsburgh, PA.
Cynthia K ThompsonDepartment of Communication Sciences and Disorders, Northwestern University, Evanston, IL.
Carnegie Mellon University · USNorthwestern University · US

Funding

Neurolinguistic Investigations of Aphasia and RecoveryR01DC001948 · NIDCD · NORTHWESTERN UNIVERSITY · PI THOMPSON, CYNTHIA K · 1992 to 2021
$7.9M
RHDBank Database DevelopmentR01DC008524 · NIDCD · CARNEGIE-MELLON UNIVERSITY · PI BRIAN MACWHINNEY · 2007 to 2026
$7.0M
A shared database for the study of the development of language fluencyR01DC015494 · NIDCD · CARNEGIE-MELLON UNIVERSITY · PI MACWHINNEY, BRIAN · 2016 to 2020
$1.6M
NIDCD NIH HHS R01 DC001948NIDCD NIH HHS R01 DC008524NIDCD NIH HHS R01 DC015494
6 · The paper itself

Abstract

Purpose Analysis of spontaneous speech samples is important for determining patterns of language production in people with aphasia. To accomplish this, researchers and clinicians can use either hand coding or computer-automated methods. In a comparison of the two methods using the hand-coding NNLA (Northwestern Narrative Language Analysis) and automatic transcript analysis by CLAN (Computerized Language Analysis), Hsu and Thompson (2018) found good agreement for 32 of 51 linguistic variables. The comparison showed little difference between the two methods for coding most general (i.e., utterance length, rate of speech production), lexical, and morphological measures. However, the NNLA system coded grammatical measures (i.e., sentence and verb argument structure) that CLAN did not. Because of the importance of quantifying these aspects of language, the current study sought to implement a new, single, composite CLAN command for the full set of 51 NNLA codes and to evaluate its reliability for coding aphasic language samples. Method Eighteen manually coded NNLA transcripts from eight people with aphasia and 10 controls were converted into CHAT (Codes for the Human Analysis of Talk) files for compatibility with CLAN commands. Rules from the NNLA manual were translated into programmed rules for CLAN computation of lexical, morphological, utterance-level, sentence-level, and verb argument structure measures. Results The new C-NNLA (CLAN command to compute the full set of NNLA measures) program automatically computes 50 of the 51 NNLA measures and generates the results in a summary spreadsheet. The only measure it does not compute is the number of verb particles. Statistical tests revealed no significant difference between C-NNLA results and those generated by manual coding for 44 of the 50 measures. C-NNLA results were not comparable to manual coding for the six verb argument measures. Conclusion Clinicians and researchers can use the automatic C-NNLA to analyze important variables required for quantification of grammatical deficits in aphasia in a way that is fast, replicable, and accessible without extensive linguistic knowledge and training.

Indexed as

AphasiaLanguageAutomationHumansLinguisticsReproducibility of Results

Identifiers

PMID32464070
PMCPMC7839033
OpenAlexW3029585372

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.