Evidence map›Paper›PMID 38913896›Full record

ReviewProceedings of the National Academy of Sciences of the United States of America2024

Representations and generalization in artificial and brain neural networks.

Qianyi Li, Ben Sorscher, Haim Sompolinsky

Abstract readReview
In one paragraph

Review in Proceedings of the National Academy of Sciences of the United States of America, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Review
  2. Article
  3. Toward a Generalizable Prediction Model of Molten Salt Mixture Density with Chemistry-Informed Transfer Learning.Chemphyschem : a European journal of chemical physics and physical chemistry · 2025
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Enhanced visibility graph for EEG classification.Frontiers in neuroscience · 2025
    Article
  9. Review
  10. Article
  11. Article
  12. Machine learning meets physics: A two-way street.Proceedings of the National Academy of Sciences of the United States of America · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Qianyi Li *The Harvard Biophysics Graduate Program, Harvard University, Cambridge, MA 02138.ORCID 0000-0002-1448-4566
Ben Sorscher *The Applied Physics Department, Stanford University, Stanford, CA 94305.ORCID 0000-0002-0339-1356
Haim SompolinskyCenter for Brain Science, Harvard University, Cambridge, MA 02138.

Funding

DOD | USN | Office of Naval Research (ONR) No.N0014-23-1-2051
6 · The paper itself

Abstract

Humans and animals excel at generalizing from limited data, a capability yet to be fully replicated in artificial intelligence. This perspective investigates generalization in biological and artificial deep neural networks (DNNs), in both in-distribution and out-of-distribution contexts. We introduce two hypotheses: First, the geometric properties of the neural manifolds associated with discrete cognitive entities, such as objects, words, and concepts, are powerful order parameters. They link the neural substrate to the generalization capabilities and provide a unified methodology bridging gaps between neuroscience, machine learning, and cognitive science. We overview recent progress in studying the geometry of neural manifolds, particularly in visual object recognition, and discuss theories connecting manifold dimension and radius to generalization capacity. Second, we suggest that the theory of learning in wide DNNs, especially in the thermodynamic limit, provides mechanistic insights into the learning processes generating desired neural representational geometries and generalization. This includes the role of weight norm regularization, network architecture, and hyper-parameters. We will explore recent advances in this theory and ongoing challenges. We also discuss the dynamics of learning and its relevance to the issue of representational drift in the brain.

Indexed as

BrainNeural Networks, ComputerAnimalsArtificial IntelligenceCognitionGeneralization, PsychologicalHumansModels, Neurologicaldeep neural networksfew-shot learningneural manifoldsrepresentational driftvisual cortex

Identifiers

PMID38913896
PMCPMC11228472

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.