ArticlePsychonomic bulletin & review2023
The multimodal facilitation effect in human communication.
Article in Psychonomic bulletin & review, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
11 citing papers in PubMed.
- Rhesus monkeys use both eye and head gaze to reallocate covert spatial attention facilitating visual perception.Cognitive, affective & behavioral neuroscience · 2026Article
- Social interaction shapes and boosts second language learning: virtual reality can show us how.NPJ science of learning · 2025Review
- Eye-tracking context formality effects in German and Japanese sentence processing.Scientific reports · 2025Article
- Prior expectations guide multisensory integration during face-to-face communication.PLoS computational biology · 2025Article
- Effects of subliminal emotional facial expressions on language comprehension as revealed by event-related brain potentials.Scientific reports · 2025Article
- The ECOLANG Multimodal Corpus of adult-child and adult-adult Language.Scientific data · 2025Article
- The impact of face masks on face-to-face neural tracking of speech: Auditory and visual obstacles.Heliyon · 2024Article
- Gestures speed up responses to questions.Language, cognition and neuroscience · 2024Article
- The Processing of Audiovisual Speech Is Linked with Vocabulary in Autistic and Nonautistic Children: An ERP Study.Brain sciences · 2023Article
- Turn-taking in human face-to-face interaction is multimodal: gaze direction and manual gestures aid the coordination of turn transitions.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2023Article
- Multimodal processing in face-to-face interactions: A bridging link between psycholinguistics and sensory neuroscience.Frontiers in human neuroscience · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
During face-to-face communication, recipients need to rapidly integrate a plethora of auditory and visual signals. This integration of signals from many different bodily articulators, all offset in time, with the information in the speech stream may either tax the cognitive system, thus slowing down language processing, or may result in multimodal facilitation. Using the classical shadowing paradigm, participants shadowed speech from face-to-face, naturalistic dyadic conversations in an audiovisual context, an audiovisual context without visual speech (e.g., lips), and an audio-only context. Our results provide evidence of a multimodal facilitation effect in human communication: participants were faster in shadowing words when seeing multimodal messages compared with when hearing only audio. Also, the more visual context was present, the fewer shadowing errors were made, and the earlier in time participants shadowed predicted lexical items. We propose that the multimodal facilitation effect may contribute to the ease of fast face-to-face conversational interaction.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.