Evidence map›Paper›PMID 37847731›Full record

ArticleProceedings of the National Academy of Sciences of the United States of America2023

Modeling naturalistic face processing in humans with deep convolutional neural networks.

Guo Jiahui, Ma Feilong, Matteo Visconti di Oleggio Castello, Samuel A Nastase, James V Haxby, M Ida Gobbini

Abstract read
In one paragraph

Article in Proceedings of the National Academy of Sciences of the United States of America, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed.

  1. Article
  2. The state of modelling face processing in humans with deep learning.British journal of psychology (London, England : 1953) · 2026
    Review
  3. Article
  4. Article
  5. Sensory encoding of emotion conveyed by the face and visual context.Social cognitive and affective neuroscience · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Linking faces to social cognition: The temporal pole as a potential social switch.Proceedings of the National Academy of Sciences of the United States of America · 2024
    Article
  14. Neural computations in prosopagnosia.Cerebral cortex (New York, N.Y. : 1991) · 2024
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Guo Jiahui *Center for Cognitive Neuroscience, Dartmouth College, Hanover, NH 03755.ORCID 0000-0002-1528-9025
Ma Feilong *Center for Cognitive Neuroscience, Dartmouth College, Hanover, NH 03755.ORCID 0000-0002-6838-3971
Matteo Visconti di Oleggio CastelloHelen Wills Neuroscience Institute, University of California, Berkeley, CA 94720.ORCID 0000-0001-7931-5272
Samuel A NastasePrinceton Neuroscience Institute, Princeton University, Princeton, NJ 08544.ORCID 0000-0001-7013-5275
James V HaxbyCenter for Cognitive Neuroscience, Dartmouth College, Hanover, NH 03755.ORCID 0000-0002-6558-3118
M Ida GobbiniDepartment of Medical and Surgical Sciences, University of Bologna, Bologna 40138, Italy.ORCID 0000-0001-6727-7934

Funding

Infrastructure for hyperaligning fMRI data and estimating functional topographiesR01MH127199 · NIMH · DARTMOUTH COLLEGE · PI GOBBINI, MARIA I, HAXBY, JAMES V · 2022 to 2025
$2.5M
NIMH NIH HHS R01 MH127199
6 · The paper itself

Abstract

Deep convolutional neural networks (DCNNs) trained for face identification can rival and even exceed human-level performance. The ways in which the internal face representations in DCNNs relate to human cognitive representations and brain activity are not well understood. Nearly all previous studies focused on static face image processing with rapid display times and ignored the processing of naturalistic, dynamic information. To address this gap, we developed the largest naturalistic dynamic face stimulus set in human neuroimaging research (700+ naturalistic video clips of unfamiliar faces). We used this naturalistic dataset to compare representational geometries estimated from DCNNs, behavioral responses, and brain responses. We found that DCNN representational geometries were consistent across architectures, cognitive representational geometries were consistent across raters in a behavioral arrangement task, and neural representational geometries in face areas were consistent across brains. Representational geometries in late, fully connected DCNN layers, which are optimized for individuation, were much more weakly correlated with cognitive and neural geometries than were geometries in late-intermediate layers. The late-intermediate face-DCNN layers successfully matched cognitive representational geometries, as measured with a behavioral arrangement task that primarily reflected categorical attributes, and correlated with neural representational geometries in known face-selective topographies. Our study suggests that current DCNNs successfully capture neural cognitive processes for categorical attributes of faces but less accurately capture individuation and dynamic features.

Indexed as

Facial RecognitionBrainHumansImage Processing, Computer-AssistedNeural Networks, ComputerNeuroimagingartificial neural networkdeep neural networkface identificationhyperalignmentnaturalistic stimuli

Identifiers

PMID37847731
PMCPMC10614847

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.