Evidence map›Paper›PMID 38250021›Full record

ArticleIEEE Winter Conference on Applications of Computer Vision. IEEE Winter Conference on Applications of Computer Vision2021

Synthetic Expressions are Better Than Real for Learning to Detect Facial Actions.

Koichiro Niinuma, Itir Onal Ertugrul, Jeffrey F Cohn, László A Jeni

Abstract read
In one paragraph

Article in IEEE Winter Conference on Applications of Computer Vision. IEEE Winter Conference on Applications of Computer Vision, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Improving Dysarthric Speech Segmentation With Emulated and Synthetic Augmentation.IEEE journal of translational engineering in health and medicine · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Koichiro NiinumaFujitsu Laboratories of America, Pittsburgh, PA, USA.
Itir Onal ErtugrulTilburg University, Tilburg, The Netherlands.
Jeffrey F CohnUniversity of Pittsburgh, Pittsburgh, PA, USA.
László A JeniCarnegie Mellon University, Pittsburgh, PA, USA.

Funding

Measuring Automated Behavioral Observations & Vocal Expressions (ABOVE) while Recording from the BrainUH3NS100549 · NINDS · BAYLOR COLLEGE OF MEDICINE · PI GOODMAN, WAYNE K · 2016 to 2022
$7.8M
Automatic Multimodal Affect Detection for Research and Clinical Use R01MH096951 · NIMH · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI COHN, JEFFREY F · 2012 to 2021
$5.6M
NIMH NIH HHS R01 MH096951NINDS NIH HHS UH3 NS100549
6 · The paper itself

Abstract

Critical obstacles in training classifiers to detect facial actions are the limited sizes of annotated video databases and the relatively low frequencies of occurrence of many actions. To address these problems, we propose an approach that makes use of facial expression generation. Our approach reconstructs the 3D shape of the face from each video frame, aligns the 3D mesh to a canonical view, and then trains a GAN-based network to synthesize novel images with facial action units of interest. To evaluate this approach, a deep neural network was trained on two separate datasets: One network was trained on video of synthesized facial expressions generated from FERA17; the other network was trained on unaltered video from the same database. Both networks used the same train and validation partitions and were tested on the test partition of actual video from FERA17. The network trained on synthesized facial expressions outperformed the one trained on actual facial expressions and surpassed current state-of-the-art approaches.

Identifiers

PMID38250021
PMCPMC10798354

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.