ArticleProceedings of the IEEE. Institute of Electrical and Electronics Engineers2023
Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotion: Drawing Insights From Psychology, Engineering, and the Arts, This Article Provides a Comprehensive Overview of the Field of Emotion Analysis in Visual Media and Discusses the Latest Research, Systems, Challenges, Ethical Implications, and Potential Impact of Artificial Emotional Intelligence on Society.
Article in Proceedings of the IEEE. Institute of Electrical and Electronics Engineers, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
12 citing papers in PubMed, 72 citations in OpenAlex.
- Enigma of autism regression mechanistic pathways, clinical phenotypes, and early intervention implications.World journal of clinical pediatrics · 2026Review
- Virtual reality-induced emotion recognition with deep learning-based multimodal physiological feature fusion.Frontiers in psychology · 2026Article
- From media engagement to global impact: a serial moderated mediation model of cultural relatability and emotional resonance in Chinese culture communication.Frontiers in psychology · 2026Article
- The role of picture books in supporting children's emotions: perspectives of Saudi kindergarten teachers.Frontiers in psychology · 2026Article
- Internet Memes as Drivers of Health Narratives and Infodemics: Integrative Review.JMIR infodemiology · 2025Review
- The silent strain beyond the screen: conceptualizing digital compassion fatigue in nursing.BMC nursing · 2025Article
- Acoustic-based machine learning approaches for depression detection in Chinese university students.Frontiers in public health · 2025Article
- Hopfield and Hinton's neural network revolution and the future of AI.Patterns (New York, N.Y.) · 2024Article
- Article
- Incorporating simulated spatial context information improves the effectiveness of contrastive learning models.Patterns (New York, N.Y.) · 2024Article
- Article
- Bodily expressed emotion understanding through integrating Laban movement analysis.Patterns (New York, N.Y.) · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
7 authors at 4 institutions in 3 countries.
Funding
Abstract
The emergence of artificial emotional intelligence technology is revolutionizing the fields of computers and robotics, allowing for a new level of communication and understanding of human behavior that was once thought impossible. While recent advancements in deep learning have transformed the field of computer vision, automated understanding of evoked or expressed emotions in visual media remains in its infancy. This foundering stems from the absence of a universally accepted definition of "emotion," coupled with the inherently subjective nature of emotions and their intricate nuances. In this article, we provide a comprehensive, multidisciplinary overview of the field of emotion analysis in visual media, drawing on insights from psychology, engineering, and the arts. We begin by exploring the psychological foundations of emotion and the computational principles that underpin the understanding of emotions from images and videos. We then review the latest research and systems within the field, accentuating the most promising approaches. We also discuss the current technological challenges and limitations of emotion analysis, underscoring the necessity for continued investigation and innovation. We contend that this represents a "Holy Grail" research problem in computing and delineate pivotal directions for future inquiry. Finally, we examine the ethical ramifications of emotion-understanding technologies and contemplate their potential societal impacts. Overall, this article endeavors to equip readers with a deeper understanding of the domain of emotion analysis in visual media and to inspire further research and development in this captivating and rapidly evolving field.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.