Evidence map›Paper›PMID 37286563›Full record

ArticleNature communications2023

Brain-optimized deep neural network models of human visual areas learn non-hierarchical representations.

Ghislain St-Yves, Emily J Allen, Yihan Wu, Kendrick Kay, Thomas Naselaris

Abstract read
In one paragraph

Article in Nature communications, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 20 papers.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

20 citing papers in PubMed.

  1. Making models disagree to learn how brains compute.Nature reviews. Neuroscience · 2026
    Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. The Geometry of Low- and High-Level Perceptual Spaces.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2024
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Ghislain St-YvesDepartment of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA.
Emily J AllenDepartment of Psychology, University of Minnesota, Minneapolis, MN, 55455, USA.ORCID 0000-0002-8221-4875
Yihan WuGraduate Program in Cognitive Science, University of Minnesota, Minneapolis, MN, 55455, USA.
Kendrick KayCenter for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, 55455, USA.
Thomas NaselarisDepartment of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA. nase0005@umn.edu.ORCID 0009-0004-4041-3157

Funding

Seen and mental images in visual cortexR01EY023384 · NEI · UNIVERSITY OF MINNESOTA · PI HERMES, DORA, NASELARIS, THOMAS P · 2014 to 2025
$3.4M
CRCNS Data Sharing Proposal: One hundred thousand mental imagesR01EY038606 · NEI · UNIVERSITY OF MINNESOTA · PI THOMAS P NASELARIS · 2025 to 2026
$765k
NEI NIH HHS R01 EY023384NEI NIH HHS R01 EY038606
6 · The paper itself

Abstract

Deep neural networks (DNNs) optimized for visual tasks learn representations that align layer depth with the hierarchy of visual areas in the primate brain. One interpretation of this finding is that hierarchical representations are necessary to accurately predict brain activity in the primate visual system. To test this interpretation, we optimized DNNs to directly predict brain activity measured with fMRI in human visual areas V1-V4. We trained a single-branch DNN to predict activity in all four visual areas jointly, and a multi-branch DNN to predict each visual area independently. Although it was possible for the multi-branch DNN to learn hierarchical representations, only the single-branch DNN did so. This result shows that hierarchical representations are not necessary to accurately predict human brain activity in V1-V4, and that DNNs that encode brain-like visual representations may differ widely in their architecture, ranging from strict serial hierarchies to multiple independent branches.

Indexed as

BrainNeural Networks, ComputerAnimalsHumansLearningMagnetic Resonance ImagingPrimates

Identifiers

PMID37286563
PMCPMC10247700

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.