Evidence map›Paper›PMID 36823136›Full record

ArticleNature communications2023

Abstract representations emerge naturally in neural networks trained to perform multiple tasks.

W Jeffrey Johnston, Stefano Fusi

Abstract read
In one paragraph

Article in Nature communications, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 46 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
46citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

46 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Order parameters and phase transitions of continual learning in deep neural networks.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  14. Article
  15. Neural representations of beliefs in a multi-dimensional inference task.bioRxiv : the preprint server for biology · 2026
    Article
  16. Article
  17. Mining the gaps: Deciphering Alzheimer's biology through AI-driven reconciliation.The journal of prevention of Alzheimer's disease · 2025
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

2 authors.

W Jeffrey JohnstonCenter for Theoretical Neuroscience, Columbia University, New York, NY, USA. wjeffreyjohnston@gmail.com.ORCID 0000-0002-4725-8602
Stefano FusiCenter for Theoretical Neuroscience, Columbia University, New York, NY, USA. sf2237@columbia.edu.ORCID 0000-0002-3035-6652

Funding

Core Research Computing FacilityG20RR030893 · NCRR · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI PURDY, MICHAEL · 2010 to 2010
$10.0M
NCRR NIH HHS G20 RR030893
6 · The paper itself

Abstract

Humans and other animals demonstrate a remarkable ability to generalize knowledge across distinct contexts and objects during natural behavior. We posit that this ability to generalize arises from a specific representational geometry, that we call abstract and that is referred to as disentangled in machine learning. These abstract representations have been observed in recent neurophysiological studies. However, it is unknown how they emerge. Here, using feedforward neural networks, we demonstrate that the learning of multiple tasks causes abstract representations to emerge, using both supervised and reinforcement learning. We show that these abstract representations enable few-sample learning and reliable generalization on novel tasks. We conclude that abstract representations of sensory and cognitive variables may emerge from the multiple behaviors that animals exhibit in the natural world, and, as a consequence, could be pervasive in high-level brain regions. We also make several specific predictions about which variables will be represented abstractly.

Indexed as

BrainNeural Networks, ComputerAnimalsHumans

Identifiers

PMID36823136
PMCPMC9950464

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.