Evidence map›Paper›PMID 35538295›Full record

ArticleBehavior research methods2023

Infant AFAR: Automated facial action recognition in infants.

Itir Onal Ertugrul, Yeojin Amy Ahn, Maneesh Bilalpur, Daniel S Messinger, Matthew L Speltz, Jeffrey F Cohn

Open access · hybridAbstract read
In one paragraph

Article in Behavior research methods, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
8.3field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 25 citations in OpenAlex.

  1. Article
  2. Smiling in time: the interactive development of infant smiling with mothers, fathers and strangers.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Reconstructing 3D Face of Infants in Social Interactions Using Morphable Models of Non-Infants.Eurographics ... Workshop on 3D Object Retrieval : EG 3DOR. Eurographics Workshop on 3D Object Retrieval · 2022
    Article
  9. Computational approaches to understanding interaction and development.Advances in child development and behavior · 2022
    Article
  10. Automated measurement of infant and mother Duchenne facial expressions in the Face-to-Face/Still-Face.Infancy : the official journal of the International Society on Infant Studies
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 4 institutions in 2 countries.

Itir Onal ErtugrulUtrecht University, Utrecht, The Netherlands. i.onalertugrul@uu.nl.
Yeojin Amy AhnUniversity of Miami, Miami, FL, USA.
Maneesh BilalpurUniversity of Pittsburgh, Pittsburgh, PA, USA.
Daniel S MessingerUniversity of Miami, Miami, FL, USA.
Matthew L SpeltzUniversity of Washington, Seattle, WA, USA.
Jeffrey F CohnUniversity of Pittsburgh, Pittsburgh, PA, USA.
University of Miami · USUniversity of Pittsburgh · USUniversity of Washington · USUtrecht University · NL

Funding

Transform Dissemination and Implementation Science in CTSA ProgramsUL1TR002319 · NCATS · UNIVERSITY OF WASHINGTON · PI John K. Amory · 2017 to 2026
$100.0M
Institute of Translational Health SciencesUL1TR000423 · NCATS · UNIVERSITY OF WASHINGTON · PI DISIS, MARY L. · 2012 to 2016
$49.4M
Automatic Multimodal Affect Detection for Research and Clinical Use R01MH096951 · NIMH · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI COHN, JEFFREY F · 2012 to 2021
$5.6M
CFM: Longitudinal Outcomes in Children pre-Kindergarten (CLOCK)R01DE022438 · NIDCR · SEATTLE CHILDREN'S HOSPITAL · PI HEIKE, CARRIE LYN, SPELTZ, MATTHEW LOUIS · 2012 to 2018
$4.7M
Modeling the Dynamics of Early Communication and DevelopmentR01GM105004 · NIGMS · UNIVERSITY OF MIAMI CORAL GABLES · PI CHOW, SY-MIIN, COHN, JEFFREY F · 2013 to 2016
$2.1M
Craniofacial Microsmia: Facial Expression from Ages 1 to 3 YearsR03DE026513 · NIDCR · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI COHN, JEFFREY F · 2017 to 2018
$323k
NCATS NIH HHS UL1 TR000423NCATS NIH HHS UL1 TR002319NIDCR NIH HHS R01 DE022438NIDCR NIH HHS R03 DE026513NIGMS NIH HHS R01 GM105004NIMH NIH HHS R01 MH096951
6 · The paper itself

Abstract

Automated detection of facial action units in infants is challenging. Infant faces have different proportions, less texture, fewer wrinkles and furrows, and unique facial actions relative to adults. For these and related reasons, action unit (AU) detectors that are trained on adult faces may generalize poorly to infant faces. To train and test AU detectors for infant faces, we trained convolutional neural networks (CNN) in adult video databases and fine-tuned these networks in two large, manually annotated, infant video databases that differ in context, head pose, illumination, video resolution, and infant age. AUs were those central to expression of positive and negative emotion. AU detectors trained in infants greatly outperformed ones trained previously in adults. Training AU detectors across infant databases afforded greater robustness to between-database differences than did training database specific AU detectors and outperformed previous state-of-the-art in infant AU detection. The resulting AU detection system, which we refer to as Infant AFAR (Automated Facial Action Recognition), is available to the research community for further testing and applications in infant emotion, social interaction, and related topics.

Indexed as

Facial ExpressionFacial RecognitionDatabases, FactualEmotionsHumansInfantNeural Networks, ComputerSocial InteractionAutomatic facial action unit detectionCross domain generalizabilityDeep learningFacial action coding systemInfant behavior

Identifiers

PMID35538295
PMCPMC9646921
OpenAlexW4280592850

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.