ArticleNature neuroscience2020
Machine translation of cortical activity to text with an encoder-decoder framework.
Article in Nature neuroscience, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 100 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
100 citing papers in PubMed, 1 synthesis or guideline pooled it, 315 citations in OpenAlex.
- Decoding Intracranial EEG With Machine Learning: A Systematic Review.Frontiers in human neuroscience · 2022Pooled it
- Simultaneous speech and gesture decoding for multimodal communication in paralysis.Nature neuroscience · 2026Article
- Speech Brain-Computer Interfaces: A New Pathway for Restoring Communication in Anarthria.Neuroscience bulletin · 2026Article
- Towards neuromorphic neurotechnologies: integrating brain-inspired computing with brain-computer interfaces.npj biomedical innovations · 2026Review
- Distinct neural processes link speech planning and execution.Nature human behaviour · 2026Article
- Shared latent representations of speech production for cross-patient speech decoding.Nature communications · 2026Article
- Minimally invasive implantation of scalable high-density cortical microelectrode arrays for multimodal neural decoding and stimulation.Nature biomedical engineering · 2026Article
- Advances in neuroprostheses: interfaces, materials, and applications.Nano convergence · 2026Review
- Stable speech BCI performance during slow progression of ALS: A longitudinal ECoG study.Research square · 2026Article
- An open dataset of multidimensional signals based on different speech patterns in pragmatic Mandarin.Scientific data · 2025Article
- Revealing spatiotemporal neural activation patterns in electrocorticography recordings of human speech production by mutual information.Neuroscience informatics · 2025Article
- Towards decoding individual words from non-invasive brain recordings.Nature communications · 2025Article
- Real-time decoding of full-spectrum Chinese using brain-computer interface.Science advances · 2025Article
- Artificial intelligence guided Raman spectroscopy in biomedicine: Applications and prospects.Journal of pharmaceutical analysis · 2025Review
- Transfer learning via distributed brain recordings enables reliable speech decoding.Nature communications · 2025Article
- Progress, challenges and future of linguistic neural decoding with deep learning.Communications biology · 2025Review
- Neuronal Decoding of Decisions in Multidimensional Feature Space Using a Gated Recurrent Variational Autoencoder.bioRxiv : the preprint server for biology · 2025Article
- Investigating the benefits of artificial neural networks over linear approaches to BMI decoding.Journal of neural engineering · 2025Article
- VocalMind: A Stereotactic EEG Dataset for Vocalized, Mimed, and Imagined Speech in Tonal Language.Scientific data · 2025Article
- A streaming brain-to-voice neuroprosthesis to restore naturalistic communication.Nature neuroscience · 2025Article
40 more citing papers are in PubMed but not listed here.
Corrections and comments
- Commented on by
Authors and funding
3 authors at 1 institution in 1 country.
Funding
Abstract
A decade after speech was first decoded from human brain signals, accuracy and speed remain far below that of natural speech. Here we show how to decode the electrocorticogram with high accuracy and at natural-speech rates. Taking a cue from recent advances in machine translation, we train a recurrent neural network to encode each sentence-length sequence of neural activity into an abstract representation, and then to decode this representation, word by word, into an English sentence. For each participant, data consist of several spoken repeats of a set of 30-50 sentences, along with the contemporaneous signals from ~250 electrodes distributed over peri-Sylvian cortices. Average word error rates across a held-out repeat set are as low as 3%. Finally, we show how decoding with limited data can be improved with transfer learning, by training certain layers of the network under multiple participants' data.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.