ArticleFrontiers in human neuroscience2019
The Principle of Inverse Effectiveness in Audiovisual Speech Perception.
Article in Frontiers in human neuroscience, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
26 citing papers in PubMed.
- Goal-directed action modulates audiovisual multisensory perception.Attention, perception & psychophysics · 2026Article
- Auditory-Somatosensory Interactions in Speech Perception in Individuals With Hearing Impairment: An Exploratory Case Study.Journal of speech, language, and hearing research : JSLHR · 2026Article
- Audio-visual speech-in-noise tests for evaluating speech reception thresholds: A scoping review.PloS one · 2026Article
- Linking brain activation to clinical outcomes: an fNIRS study in cochlear implant users and normal hearing individuals.Neurophotonics · 2026Article
- Impact of visual mouth image presentation on speech perception in noise in normal hearing subjects and cochlear implant users.PloS one · 2026Article
- Integration of audiovisual speech perception: From infancy to older adults.The Journal of the Acoustical Society of America · 2025Article
- Reassessing the Benefits of Audiovisual Integration to Speech Perception and Intelligibility.Journal of speech, language, and hearing research : JSLHR · 2025Article
- A drift diffusion model analysis of age-related impact on multisensory decision-making processes.Scientific reports · 2024Article
- Attention Drives Visual Processing and Audiovisual Integration During Multimodal Communication.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2024Article
- Article
- Dynamical predictive coding with reservoir computing performs noise-robust multi-sensory speech recognition.Frontiers in computational neuroscience · 2024Article
- Improved speech intelligibility in the presence of congruent vibrotactile speech input.Scientific reports · 2023Article
- Influence of face masks on recalibration of phonetic categories.Attention, perception & psychophysics · 2023Article
- Investigation of Cross-Language and Stimulus-Dependent Effects on the McGurk Effect with Finnish and Japanese Speakers and Listeners.Brain sciences · 2023Article
- Reality and illusion: the assessment of angular separation of multi-modal signallers in a duetting bird.Proceedings. Biological sciences · 2022Article
- Semantically congruent audiovisual integration with modal-based attention accelerates auditory short-term memory retrieval.Attention, perception & psychophysics · 2022Article
- Effects of training and using an audio-tactile sensory substitution device on speech-in-noise understanding.Scientific reports · 2022Article
- Semantic Cues Modulate Children's and Adults' Processing of Audio-Visual Face Mask Speech.Frontiers in psychology · 2022Article
- Unity Assumption in Audiovisual Emotion Perception.Frontiers in neuroscience · 2022Article
- Audiovisual speech is more than the sum of its parts: Auditory-visual superadditivity compensates for age-related declines in audible and lipread speech intelligibility.Psychology and aging · 2021Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
We assessed how synchronous speech listening and lipreading affects speech recognition in acoustic noise. In simple audiovisual perceptual tasks, inverse effectiveness is often observed, which holds that the weaker the unimodal stimuli, or the poorer their signal-to-noise ratio, the stronger the audiovisual benefit. So far, however, inverse effectiveness has not been demonstrated for complex audiovisual speech stimuli. Here we assess whether this multisensory integration effect can also be observed for the recognizability of spoken words. To that end, we presented audiovisual sentences to 18 native-Dutch normal-hearing participants, who had to identify the spoken words from a finite list. Speech-recognition performance was determined for auditory-only, visual-only (lipreading), and auditory-visual conditions. To modulate acoustic task difficulty, we systematically varied the auditory signal-to-noise ratio. In line with a commonly observed multisensory enhancement on speech recognition, audiovisual words were more easily recognized than auditory-only words (recognition thresholds of -15 and -12 dB, respectively). We here show that the difficulty of recognizing a particular word, either acoustically or visually, determines the occurrence of inverse effectiveness in audiovisual word integration. Thus, words that are better heard or recognized through lipreading, benefit less from bimodal presentation. Audiovisual performance at the lowest acoustic signal-to-noise ratios (45%) fell below the visual recognition rates (60%), reflecting an actual deterioration of lipreading in the presence of excessive acoustic noise. This suggests that the brain may adopt a strategy in which attention has to be divided between listening and lipreading.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.