ArticlePsychonomic bulletin & review2020
Face viewing behavior predicts multisensory gain during speech perception.
Article in Psychonomic bulletin & review, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
14 citing papers in PubMed, 20 citations in OpenAlex.
- Gaze dynamics of cued speech perception.Scientific reports · 2026Article
- Do You Fail to Recognize Me with a Mask on? The Impact of Voice on Mask-Occluded Facial Identity Recognition.Behavioral sciences (Basel, Switzerland) · 2026Article
- The noisy encoding of disparity model predicts perception of the McGurk effect in native Japanese speakers.Frontiers in neuroscience · 2024Article
- Synthetic faces generated with the facial action coding system or deep neural networks improve speech-in-noise perception, but not as much as real faces.Frontiers in neuroscience · 2024Article
- Article
- Modality-Specific Perceptual Learning of Vocoded Auditory versus Lipread Speech: Different Effects of Prior Information.Brain sciences · 2023Article
- Lipreading: A Review of Its Continuing Importance for Speech Recognition With an Acquired Hearing Loss and Possibilities for Effective Training.American journal of audiology · 2022Review
- Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex.NeuroImage · 2022Article
- Inferior Occipital Gyrus Is Organized along Common Gradients of Spatial and Face-Part Selectivity.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2021Article
- Weak observer-level correlation and strong stimulus-level correlation between the McGurk effect and audiovisual speech-in-noise: A causal inference explanation.Cortex; a journal devoted to the study of the nervous system and behavior · 2020Article
- A relationship between Autism-Spectrum Quotient and face viewing behavior in 98 participants.PloS one · 2020Article
- Using principal component analysis to characterize eye movement fixation patterns during face viewing.Journal of vision · 2019Article
- Degree of Language Experience Modulates Visual Attention to Visible Speech and Iconic Gestures During Clear and Degraded Speech Comprehension.Cognitive science · 2019Article
- Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors at 1 institution in 1 country.
Funding
Abstract
Visual information from the face of an interlocutor complements auditory information from their voice, enhancing intelligibility. However, there are large individual differences in the ability to comprehend noisy audiovisual speech. Another axis of individual variability is the extent to which humans fixate the mouth or the eyes of a viewed face. We speculated that across a lifetime of face viewing, individuals who prefer to fixate the mouth of a viewed face might accumulate stronger associations between visual and auditory speech, resulting in improved comprehension of noisy audiovisual speech. To test this idea, we assessed interindividual variability in two tasks. Participants (n = 102) varied greatly in their ability to understand noisy audiovisual sentences (accuracy from 2-58%) and in the time they spent fixating the mouth of a talker enunciating clear audiovisual syllables (3-98% of total time). These two variables were positively correlated: a 10% increase in time spent fixating the mouth equated to a 5.6% increase in multisensory gain. This finding demonstrates an unexpected link, mediated by histories of visual exposure, between two fundamental human abilities: processing faces and understanding speech.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.