Evidence map›Paper›PMID 33824315›Full record

ArticleNature communications2021

Limits to visual representational correspondence between convolutional neural networks and the human brain.

Yaoda Xu, Maryam Vaziri-Pashkam

Erratum issuedAbstract read
In one paragraph

Article in Nature communications, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 62 papers.

0numbers the graph read from it
0cells of the map it votes in
62citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

62 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. A population vector model of visual working memory for real-world scenes.Journal of experimental psychology. General · 2026
    Article
  6. Review
  7. What makes memories vivid?Journal of experimental psychology. General · 2026
    Article
  8. A Population Vector Model of Visual Working Memory for Real-World Scenes.bioRxiv : the preprint server for biology · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Synthesizing images to map neural networks to the human brain.bioRxiv : the preprint server for biology · 2025
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review

2 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

2 authors.

Yaoda XuPsychology Department, Yale University, New Haven, CT, USA. xucogneuro@gmail.com.ORCID http://orcid.org/0000-0002-8697-314X
Maryam Vaziri-PashkamLaboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, MD, USA.

Funding

Functional Anatomy Of Perceptual and Attentional Systems in the Primate BrainZIAMH002035 · NIMH · NATIONAL INSTITUTE OF MENTAL HEALTH · PI UNGERLEIDER, LESLIE G · 2009 to 2021
$13.9M
Adaptive visual representation in human posterior parietal cortexR01EY030854 · NEI · YALE UNIVERSITY · PI YAODA XU · 2020 to 2026
$3.1M
Representing object ensembles in the human brain: Where, when and whatR01EY022355 · NEI · HARVARD UNIVERSITY · PI XU, YAODA · 2012 to 2014
$1.2M
Intramural NIH HHS ZIA MH002035NEI NIH HHS R01 EY022355NEI NIH HHS R01 EY030854
6 · The paper itself

Abstract

Convolutional neural networks (CNNs) are increasingly used to model human vision due to their high object categorization capabilities and general correspondence with human brain responses. Here we evaluate the performance of 14 different CNNs compared with human fMRI responses to natural and artificial images using representational similarity analysis. Despite the presence of some CNN-brain correspondence and CNNs' impressive ability to fully capture lower level visual representation of real-world objects, we show that CNNs do not fully capture higher level visual representations of real-world objects, nor those of artificial objects, either at lower or higher levels of visual representations. The latter is particularly critical, as the processing of both real-world and artificial visual stimuli engages the same neural circuits. We report similar results regardless of differences in CNN architecture, training, or the presence of recurrent processing. This indicates some fundamental differences exist in how the brain and CNNs represent visual information.

Indexed as

Neural Networks, ComputerAdolescentAdultBrainHumansImage Processing, Computer-AssistedPhotic StimulationVision, OcularYoung Adult

Identifiers

PMID33824315
PMCPMC8024324

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.