ArticleThe Journal of neuroscience : the official journal of the Society for Neuroscience2021
Neurophysiological Indices of Audiovisual Speech Processing Reveal a Hierarchy of Multisensory Integration Effects.
Article in The Journal of neuroscience : the official journal of the Society for Neuroscience, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
25 citing papers in PubMed.
- Visual speech enhances phoneme separability in human superior temporal gyrus.bioRxiv : the preprint server for biology · 2026Article
- Articulatory timing and form support distinct neural benefits during audiovisual speech.bioRxiv : the preprint server for biology · 2026Article
- Echoes of the mind's eye: Reciprocal crossmodal interaction between auditory and visual processing.iScience · 2026Article
- Stereoelectroencephalography Reveals Neural Signatures of Multisensory Integration in the Human Superior Temporal Sulcus during Audiovisual Speech Perception.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025Article
- Eye Movements in Silent Visual Speech Track Unheard Acoustic Signals and Relate to Hearing Experience.eNeuro · 2025Article
- Audiovisual integration of simple stimuli: spatial congruency effects unaffected by working memory load.Frontiers in psychology · 2025Article
- Resting-state functional connectivity changes following audio-tactile speech training.Frontiers in neuroscience · 2025Article
- Auditory cortex encodes lipreading information through spatially distributed activity.Current biology : CB · 2024Article
- Crossmodal hierarchical predictive coding for audiovisual sequences in the human brain.Communications biology · 2024Article
- A representation of abstract linguistic categories in the visual system underlies successful lipreading.NeuroImage · 2023Article
- Article
- The Development of Speaking and Singing in Infants May Play a Role in Genomics and Dementia in Humans.Brain sciences · 2023Review
- The integration of continuous audio and visual speech in a cocktail-party environment depends on attention.NeuroImage · 2023Article
- Event-Related Potentials in Assessing Visual Speech Cues in the Broader Autism Phenotype: Evidence from a Phonemic Restoration Paradigm.Brain sciences · 2023Article
- A convolutional neural network provides a generalizable model of natural sound coding by neural populations in auditory cortex.PLoS computational biology · 2023Article
- Enhancement of speech-in-noise comprehension through vibrotactile stimulation at the syllabic rate.Proceedings of the National Academy of Sciences of the United States of America · 2022Article
- Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex.NeuroImage · 2022Article
- The effects of data quantity on performance of temporal response function analyses of natural speech processing.Frontiers in neuroscience · 2022Article
- Increases in sensory noise predict attentional disruptions to audiovisual speech perception.Frontiers in human neuroscience · 2022Article
- Editorial: Neural Tracking: Closing the Gap Between Neurophysiology and Translational Medicine.Frontiers in neuroscience · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
Abstract
Seeing a speaker's face benefits speech comprehension, especially in challenging listening conditions. This perceptual benefit is thought to stem from the neural integration of visual and auditory speech at multiple stages of processing, whereby movement of a speaker's face provides temporal cues to auditory cortex, and articulatory information from the speaker's mouth can aid recognizing specific linguistic units (e.g., phonemes, syllables). However, it remains unclear how the integration of these cues varies as a function of listening conditions. Here, we sought to provide insight on these questions by examining EEG responses in humans (males and females) to natural audiovisual (AV), audio, and visual speech in quiet and in noise. We represented our speech stimuli in terms of their spectrograms and their phonetic features and then quantified the strength of the encoding of those features in the EEG using canonical correlation analysis (CCA). The encoding of both spectrotemporal and phonetic features was shown to be more robust in AV speech responses than what would have been expected from the summation of the audio and visual speech responses, suggesting that multisensory integration occurs at both spectrotemporal and phonetic stages of speech processing. We also found evidence to suggest that the integration effects may change with listening conditions; however, this was an exploratory analysis and future work will be required to examine this effect using a within-subject design. These findings demonstrate that integration of audio and visual speech occurs at multiple stages along the speech processing hierarchy.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.