Evidence map›Paper›PMID 32051467›Full record

ArticleScientific reports2020

Orthogonal Representations of Object Shape and Category in Deep Convolutional Neural Networks and Human Visual Cortex.

Astrid A Zeman, J Brendan Ritchie, Stefania Bracci, Hans Op de Beeck

Abstract read
In one paragraph

Article in Scientific reports, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Graspable foods and tools elicit similar responses in visual cortex.Cerebral cortex (New York, N.Y. : 1991) · 2024
    Article
  7. Article
  8. Article
  9. Article
  10. Graspable foods and tools elicit similar responses in visual cortex.bioRxiv : the preprint server for biology · 2024
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. The promise and peril of interactive embodied agents for studying non-verbal communication: a machine learning perspective.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2023
    Review
  16. Category Trumps Shape as an Organizational Principle of Object Space in the Human Occipitotemporal Cortex.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2023
    Article
  17. Article
  18. Deep Neural Networks and Visuo-Semantic Models Explain Complementary Components of Human Ventral-Stream Representational Dynamics.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2023
    Article
  19. A deep neural network model of the primate superior colliculus for emotion recognition.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2022
    Article
  20. Texture-like representation of objects in human visual cortex.Proceedings of the National Academy of Sciences of the United States of America · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Astrid A ZemanDepartment of Brain and Cognition & Leuven Brain Institute, KU Leuven, Leuven, Belgium. astrid.zeman@kuleuven.be.
J Brendan RitchieDepartment of Brain and Cognition & Leuven Brain Institute, KU Leuven, Leuven, Belgium.ORCID http://orcid.org/0000-0002-2402-8724
Stefania BracciDepartment of Brain and Cognition & Leuven Brain Institute, KU Leuven, Leuven, Belgium.
Hans Op de BeeckDepartment of Brain and Cognition & Leuven Brain Institute, KU Leuven, Leuven, Belgium.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Deep Convolutional Neural Networks (CNNs) are gaining traction as the benchmark model of visual object recognition, with performance now surpassing humans. While CNNs can accurately assign one image to potentially thousands of categories, network performance could be the result of layers that are tuned to represent the visual shape of objects, rather than object category, since both are often confounded in natural images. Using two stimulus sets that explicitly dissociate shape from category, we correlate these two types of information with each layer of multiple CNNs. We also compare CNN output with fMRI activation along the human visual ventral stream by correlating artificial with neural representations. We find that CNNs encode category information independently from shape, peaking at the final fully connected layer in all tested CNN architectures. Comparing CNNs with fMRI brain data, early visual cortex (V1) and early layers of CNNs encode shape information. Anterior ventral temporal cortex encodes category information, which correlates best with the final layer of CNNs. The interaction between shape and category that is found along the human visual ventral pathway is echoed in multiple deep networks. Our results suggest CNNs represent category information independently from shape, much like the human visual system.

Indexed as

Visual PerceptionAdultBrain MappingFemaleHumansMaleNerve NetNeural Networks, ComputerPattern Recognition, VisualPhotic StimulationVisual CortexVisual PathwaysYoung Adult

Identifiers

PMID32051467
PMCPMC7016009

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.