Evidence map›Paper›PMID 38332339›Full record

ArticleNature human behaviour2024

Using deep neural networks to disentangle visual and semantic information in human perception and memory.

Adva Shoham, Idan Daniel Grosbard, Or Patashnik, Daniel Cohen-Or, Galit Yovel

Abstract read
PubMed Publisher
In one paragraph

Article in Nature human behaviour, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Article
  2. Article
  3. The state of modelling face processing in humans with deep learning.British journal of psychology (London, England : 1953) · 2026
    Review
  4. How AI can advance psychological science.British journal of psychology (London, England : 1953) · 2026
    Article
  5. Article
  6. What makes memories vivid?Journal of experimental psychology. General · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Adva Shoham *School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel. advashoham@mail.tau.ac.il.ORCID http://orcid.org/0000-0002-7923-2474
Idan Daniel Grosbard *School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel.
Or PatashnikThe Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel.ORCID http://orcid.org/0000-0001-7757-6137
Daniel Cohen-OrThe Blavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel.
Galit YovelSchool of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel. gality@tauex.tau.ac.il.ORCID http://orcid.org/0000-0003-0971-2357

Funding

Israel Science Foundation (ISF) ISF 971/21
6 · The paper itself

Abstract

Mental representations of familiar categories are composed of visual and semantic information. Disentangling the contributions of visual and semantic information in humans is challenging because they are intermixed in mental representations. Deep neural networks that are trained either on images or on text or by pairing images and text enable us now to disentangle human mental representations into their visual, visual-semantic and semantic components. Here we used these deep neural networks to uncover the content of human mental representations of familiar faces and objects when they are viewed or recalled from memory. The results show a larger visual than semantic contribution when images are viewed and a reversed pattern when they are recalled. We further reveal a previously unknown unique contribution of an integrated visual-semantic representation in both perception and memory. We propose a new framework in which visual and semantic information contribute independently and interactively to mental representations in perception and memory.

Indexed as

Mental RecallNeural Networks, ComputerSemanticsVisual PerceptionAdultFacial RecognitionFemaleHumansMaleMemoryRecognition, PsychologyYoung Adult

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.