Evidence map›Paper›PMID 39103399›Full record

ArticleScientific data2024

A Multimodal Dataset for Mixed Emotion Recognition.

Pei Yang, Niqi Liu, Xinge Liu, Yezhi Shu, Wenqi Ji, Ziqi Ren, Jenny Sheng, Minjing Yu, Ran Yi, Dan Zhang and 1 more

Abstract readDataset
In one paragraph

Article in Scientific data, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Pei Yang *Tsinghua University, Department of Computer Science and Technology, Beijing, 100084, China.
Niqi Liu *Tsinghua University, Department of Computer Science and Technology, Beijing, 100084, China.
Xinge Liu *Tsinghua University, Department of Computer Science and Technology, Beijing, 100084, China.
Yezhi ShuTsinghua University, Department of Computer Science and Technology, Beijing, 100084, China.
Wenqi JiTsinghua University, Department of Computer Science and Technology, Beijing, 100084, China.
Ziqi RenTsinghua University, Department of Computer Science and Technology, Beijing, 100084, China.
Jenny ShengTsinghua University, Department of Computer Science and Technology, Beijing, 100084, China.
Minjing YuTianjin University, College of Intelligence and Computing, Tianjin, 300350, China.
Ran YiShanghai Jiao Tong University, Department of Computer Science and Engineering, Shanghai, 200240, China.
Dan ZhangTsinghua University, Department of Psychology, Beijing, 100084, China.ORCID 0000-0002-7592-3200
Yong-Jin LiuTsinghua University, Department of Computer Science and Technology, Beijing, 100084, China. liuyongjin@tsinghua.edu.cn.

Funding

National Natural Science Foundation of China (National Science Foundation of China) U1736220Tsinghua University (THU) Tsinghua University Initiative Scientific Research Program
6 · The paper itself

Abstract

Mixed emotions have attracted increasing interest recently, but existing datasets rarely focus on mixed emotion recognition from multimodal signals, hindering the affective computing of mixed emotions. On this basis, we present a multimodal dataset with four kinds of signals recorded while watching mixed and non-mixed emotion videos. To ensure effective emotion induction, we first implemented a rule-based video filtering step to select the videos that could elicit stronger positive, negative, and mixed emotions. Then, an experiment with 80 participants was conducted, in which the data of EEG, GSR, PPG, and frontal face videos were recorded while they watched the selected video clips. We also recorded the subjective emotional rating on PANAS, VAD, and amusement-disgust dimensions. In total, the dataset consists of multimodal signal data and self-assessment data from 73 participants. We also present technical validations for emotion induction and mixed emotion classification from physiological signals and face videos. The average accuracy of the 3-class classification (i.e., positive, negative, and mixed) can reach 80.96% when using SVM and features from all modalities, which indicates the possibility of identifying mixed emotional states.

Indexed as

EmotionsElectroencephalographyFacial ExpressionHumansVideo Recording

Identifiers

PMID39103399
PMCPMC11300855

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.