ArticleThe Journal of neuroscience : the official journal of the Society for Neuroscience2020
Lip-Reading Enables the Brain to Synthesize Auditory Features of Unknown Silent Speech.
Article in The Journal of neuroscience : the official journal of the Society for Neuroscience, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
33 citing papers in PubMed, 104 citations in OpenAlex.
- TENG-Based Self-Powered Silent Speech Recognition Interface: from Assistive Communication to Immersive AR/VR Interaction.Nano-micro letters · 2026Article
- Linking brain activation to clinical outcomes: an fNIRS study in cochlear implant users and normal hearing individuals.Neurophotonics · 2026Article
- Lip-Reading: Advances and Unresolved Questions in a Key Communication Skill.Audiology research · 2025Review
- Neocortical and Hippocampal Theta Oscillations Track Audiovisual Integration and Replay of Speech Memories.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025Article
- Eye Movements in Silent Visual Speech Track Unheard Acoustic Signals and Relate to Hearing Experience.eNeuro · 2025Article
- Article
- Auditory cortex encodes lipreading information through spatially distributed activity.Current biology : CB · 2024Article
- Laminar organization of visual responses in core and parabelt auditory cortex.Cerebral cortex (New York, N.Y. : 1991) · 2024Article
- A comparison of EEG encoding models using audiovisual stimuli and their unimodal counterparts.PLoS computational biology · 2024Article
- Article
- The impact of face masks on face-to-face neural tracking of speech: Auditory and visual obstacles.Heliyon · 2024Article
- Schlieren imaging and video classification of alphabet pronunciations: exploiting phonetic flows for speech recognition and speech therapy.Visual computing for industry, biomedicine, and art · 2024Article
- Article
- A representation of abstract linguistic categories in the visual system underlies successful lipreading.NeuroImage · 2023Article
- Periodic fluctuations in reading times reflect multi-word-chunking.Scientific reports · 2023Article
- Fast and Slow Rhythms of Naturalistic Reading Revealed by Combined Eye-Tracking and Electroencephalography.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2023Article
- Cortical tracking of formant modulations derived from silently presented lip movements and its decline with age.Cerebral cortex (New York, N.Y. : 1991) · 2022Article
- Differential Auditory and Visual Phase-Locking Are Observed during Audio-Visual Benefit and Silent Lip-Reading for Speech Perception.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2022Article
- Neural Tracking in Infancy Predicts Language Development in Children With and Without Family History of Autism.Neurobiology of language (Cambridge, Mass.) · 2022Article
- Faces and Voices Processing in Human and Primate Brains: Rhythmic and Multimodal Mechanisms Underlying the Evolution and Development of Speech.Frontiers in psychology · 2022Review
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors at 4 institutions in 4 countries.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Lip-reading is crucial for understanding speech in challenging conditions. But how the brain extracts meaning from, silent, visual speech is still under debate. Lip-reading in silence activates the auditory cortices, but it is not known whether such activation reflects immediate synthesis of the corresponding auditory stimulus or imagery of unrelated sounds. To disentangle these possibilities, we used magnetoencephalography to evaluate how cortical activity in 28 healthy adult humans (17 females) entrained to the auditory speech envelope and lip movements (mouth opening) when listening to a spoken story without visual input (audio-only), and when seeing a silent video of a speaker articulating another story (video-only). In video-only, auditory cortical activity entrained to the absent auditory signal at frequencies <1 Hz more than to the seen lip movements. This entrainment process was characterized by an auditory-speech-to-brain delay of ∼70 ms in the left hemisphere, compared with ∼20 ms in audio-only. Entrainment to mouth opening was found in the right angular gyrus at <1 Hz, and in early visual cortices at 1-8 Hz. These findings demonstrate that the brain can use a silent lip-read signal to synthesize a coarse-grained auditory speech representation in early auditory cortices. Our data indicate the following underlying oscillatory mechanism: seeing lip movements first modulates neuronal activity in early visual cortices at frequencies that match articulatory lip movements; the right angular gyrus then extracts slower features of lip movements, mapping them onto the corresponding speech sound features; this information is fed to auditory cortices, most likely facilitating speech parsing.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.