Evidence map›Paper›PMID 40552848›Full record

ArticleGerontology2025

Spoken Language Analysis in Aging Research: The Validity of AI-Generated Speech to Text Using OpenAI's Whisper.

Ava Naffah, Valeria A Pfeifer, Matthias R Mehl

Abstract readValidation Study
In one paragraph

Article in Gerontology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Ava NaffahDepartment of Psychology, University of Arizona, Tucson, Arizona, USA.
Valeria A PfeiferDepartment of Psychology, University of Arizona, Tucson, Arizona, USA.
Matthias R MehlDepartment of Psychology, University of Arizona, Tucson, Arizona, USA.

Funding

Regulatory and Human Study Operations (RHSO) Core CU19AG065169 · NIA · UNIVERSITY OF ARIZONA · PI BARNES, CAROL A. · 2021 to 2025
$59.8M
NIA NIH HHS U19 AG065169
6 · The paper itself

Abstract

introductionStudying what older adults say can provide important insights into cognitive, affective, and social aspects of aging. Available language analysis tools generally require audio-recorded speech to be transcribed into verbatim text, a task that has historically been performed by humans. However, recent advances in AI-based language processing open up the possibility of replacing this time- and resource-intensive task with fully automatic speech to text.

methodsThis study evaluates the accuracy of two common automatic speech-to-text tools - OpenAI's Whisper and otter.ai - relative to human-corrected transcripts. Based on two speech tasks completed by 238 older adults, we used the Linguistic Inquiry and Word Count (LIWC) to compare language features of text generated by each transcription method. The study further assessed the degree to which manual tagging of filler words (e.g., "like," "well") common in spoken language impacts the validity of the analysis.

resultsThe AI-based LIWC features evidenced very high convergence with the LIWC features derived from the human-corrected transcripts (average r = 0.98). Further, the manual tagging of filler words did not impact the validity for all LIWC features except the categories filler words and netspeak.

conclusionThese findings support that Whisper and otter.ai are valuable tools for language analysis in aging research and provide further evidence that automatic speech to text with state-of-the art AI tools is ready for psychological language research.

Indexed as

AgingArtificial IntelligenceSpeechAgedAged, 80 and overFemaleHumansLanguageLinguisticsMaleMiddle AgedNatural Language ProcessingReproducibility of ResultsAgingAILanguage analysisLinguistic Inquiry and Word CountSpeech to text

Identifiers

PMID40552848
PMCPMC12188092

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.