Evidence map›Paper›PMID 29378977›Full record

ArticleJournal of neural engineering2018

Real-time classification of auditory sentences using evoked cortical activity in humans.

David A Moses, Matthew K Leonard, Edward F Chang

Abstract read
In one paragraph

Article in Journal of neural engineering, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Brain-Computer Interface: Applications to Speech Decoding and Synthesis to Augment Communication.Neurotherapeutics : the journal of the American Society for Experimental NeuroTherapeutics · 2022
    Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Brain-Machine Interfaces: Powerful Tools for Clinical Treatment and Neuroscientific Investigations.The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry · 2019
    Review
  17. Machine Learning Approaches to Analyze Speech-Evoked Neurophysiological Responses.Journal of speech, language, and hearing research : JSLHR · 2019
    Review
  18. Article
  19. Article
  20. The Potential for a Speech Brain-Computer Interface Using Chronic Electrocorticography.Neurotherapeutics : the journal of the American Society for Experimental NeuroTherapeutics · 2019
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

David A MosesDepartment of Neurological Surgery, UC San Francisco, CA, United States of America.ORCID 0000-0002-5786-5334
Matthew K LeonardDepartment of Neurological Surgery, UC San Francisco, CA, United States of America.
Edward F ChangDepartment of Neurological Surgery, UC San Francisco, CA, United States of America.

Funding

Functional organization of the superior temporal gyrus for speech perceptionR01DC012379 · NIDCD · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI Edward Chang · 2012 to 2026
$8.3M
Functional Architecture of Human Speech Motor CortexDP2OD008627 · OD · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI CHANG, EDWARD · 2011 to 2011
$2.3M
Neocortical Mechanisms of Categorical Speech PerceptionR00NS065120 · NINDS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI CHANG, EDWARD · 2010 to 2012
$729k
The Neurophysiological Dynamics of Lexical and Sub-Lexical RepresentationsF32DC013486 · NIDCD · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI LEONARD, MATTHEW KANTER · 2013 to 2016
$168k
NIDCD NIH HHS F32 DC013486NIDCD NIH HHS R01 DC012379NIH HHS DP2 OD008627NINDS NIH HHS R00 NS065120
6 · The paper itself

Abstract

objectiveRecent research has characterized the anatomical and functional basis of speech perception in the human auditory cortex. These advances have made it possible to decode speech information from activity in brain regions like the superior temporal gyrus, but no published work has demonstrated this ability in real-time, which is necessary for neuroprosthetic brain-computer interfaces. APPROACH: Here, we introduce a real-time neural speech recognition (rtNSR) software package, which was used to classify spoken input from high-resolution electrocorticography signals in real-time. We tested the system with two human subjects implanted with electrode arrays over the lateral brain surface. Subjects listened to multiple repetitions of ten sentences, and rtNSR classified what was heard in real-time from neural activity patterns using direct sentence-level and HMM-based phoneme-level classification schemes. MAIN

resultsWe observed single-trial sentence classification accuracies of [Formula: see text] or higher for each subject with less than 7 minutes of training data, demonstrating the ability of rtNSR to use cortical recordings to perform accurate real-time speech decoding in a limited vocabulary setting. SIGNIFICANCE: Further development and testing of the package with different speech paradigms could influence the design of future speech neuroprosthetic applications.

Indexed as

Brain-Computer InterfacesComputer SystemsAcoustic StimulationAuditory CortexElectrodes, ImplantedHumansSpeechSpeech Perception

Identifiers

PMID29378977
PMCPMC10560396

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.