Evidence map›Paper›PMID 38202988›Full record

ReviewSensors (Basel, Switzerland)2023

Understanding Naturalistic Facial Expressions with Deep Learning and Multimodal Large Language Models.

Yifan Bian, Dennis Küster, Hui Liu, Eva G Krumhuber

Abstract readReview
In one paragraph

Review in Sensors (Basel, Switzerland), 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Review
  3. Review
  4. Article
  5. Article
  6. Review
  7. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Yifan BianDepartment of Experimental Psychology, University College London, London WC1H 0AP, UK.
Dennis KüsterDepartment of Mathematics and Computer Science, University of Bremen, 28359 Bremen, Germany.ORCID 0000-0001-8992-5648
Hui LiuDepartment of Mathematics and Computer Science, University of Bremen, 28359 Bremen, Germany.ORCID 0000-0002-6850-9570
Eva G KrumhuberDepartment of Experimental Psychology, University College London, London WC1H 0AP, UK.ORCID 0000-0003-1894-2517

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

This paper provides a comprehensive overview of affective computing systems for facial expression recognition (FER) research in naturalistic contexts. The first section presents an updated account of user-friendly FER toolboxes incorporating state-of-the-art deep learning models and elaborates on their neural architectures, datasets, and performances across domains. These sophisticated FER toolboxes can robustly address a variety of challenges encountered in the wild such as variations in illumination and head pose, which may otherwise impact recognition accuracy. The second section of this paper discusses multimodal large language models (MLLMs) and their potential applications in affective science. MLLMs exhibit human-level capabilities for FER and enable the quantification of various contextual variables to provide context-aware emotion inferences. These advancements have the potential to revolutionize current methodological approaches for studying the contextual influences on emotions, leading to the development of contextualized emotion models.

Indexed as

Deep LearningAwarenessEmotionsFacial ExpressionHumansLanguageautomatic facial expression recognitiondeep learningmultimodal large language modelnaturalistic context

Identifiers

PMID38202988
PMCPMC10781259

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.