Evidence map›Paper›PMID 35260860›Full record

ArticleNature neuroscience2022

Shared computational principles for language processing in humans and deep language models.

Ariel Goldstein, Zaid Zada, Eliav Buchnik, Mariano Schain, Amy Price, Bobbi Aubrey, Samuel A Nastase, Amir Feder, Dotan Emanuel, Alon Cohen and 22 more

Open access · hybridAbstract read
In one paragraph

Article in Nature neuroscience, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 179 papers.

0numbers the graph read from it
0cells of the map it votes in
179citing papers in PubMed
46.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

179 citing papers in PubMed, 423 citations in OpenAlex.

  1. Review
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. The human language processing system straightens natural speech.bioRxiv : the preprint server for biology · 2026
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. How AI can advance psychological science.British journal of psychology (London, England : 1953) · 2026
    Article

119 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

32 authors at 6 institutions in 3 countries.

Ariel GoldsteinDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA. ariel.y.goldstein@gmail.com.ORCID http://orcid.org/0000-0003-4017-3363
Zaid Zada *Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0002-3096-0059
Eliav Buchnik *Google Research, Mountain View, CA, USA.
Mariano Schain *Google Research, Mountain View, CA, USA.
Amy Price *Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0002-3560-6294
Bobbi Aubrey *Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Samuel A Nastase *Department of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0001-7013-5275
Amir Feder *Google Research, Mountain View, CA, USA.
Dotan Emanuel *Google Research, Mountain View, CA, USA.
Alon Cohen *Google Research, Mountain View, CA, USA.
Aren Jansen *Google Research, Mountain View, CA, USA.
Harshvardhan GazulaDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Gina ChoeDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Aditi RaoDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Catherine KimDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Colton CastoDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Lora FandaNew York University Grossman School of Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0003-3432-3353
Werner DoyleNew York University Grossman School of Medicine, New York, NY, USA.
Daniel FriedmanNew York University Grossman School of Medicine, New York, NY, USA.
Patricia DuganNew York University Grossman School of Medicine, New York, NY, USA.
Lucia MelloniMax Planck Institute for Empirical Aesthetics, Frankfurt, Germany.ORCID http://orcid.org/0000-0001-8743-5071
Roi ReichartFaculty of Industrial Engineering and Management, Technion, Israel Institute of Technology, Haifa, Israel.
Sasha DevoreNew York University Grossman School of Medicine, New York, NY, USA.
Adeen FlinkerNew York University Grossman School of Medicine, New York, NY, USA.
Liat HasenfratzDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Omer LevyBlavatnik School of Computer Science, Tel Aviv University, Tel Aviv, Israel.ORCID http://orcid.org/0000-0001-7300-8191
Avinatan HassidimGoogle Research, Mountain View, CA, USA.
Michael BrennerGoogle Research, Mountain View, CA, USA.
Yossi MatiasGoogle Research, Mountain View, CA, USA.
Kenneth A NormanDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0002-5887-9682
Orrin DevinskyNew York University Grossman School of Medicine, New York, NY, USA.
Uri HassonDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0002-3599-7168
Google (United States) · USPrinceton University · USNew York University · USMax Planck Institute for Empirical Aesthetics · DETechnion – Israel Institute of Technology · ILTel Aviv University · IL

Funding

Speaker-listener coupling: a novel neural approach for assessing communicationDP1HD091948 · NICHD · PRINCETON UNIVERSITY · PI HASSON, URI · 2016 to 2021
$5.6M
Spatiotemporal Organization of the Inferior Frontal Gyrus During Speech Production - Resubmission - 1R01NS109367 · NINDS · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI FLINKER, ADEEN · 2019 to 2023
$2.8M
Brain-to-brain dynamical Coupling: A New framework for the communication of social knowledgeR01MH112566 · NIMH · PRINCETON UNIVERSITY · PI HASSON, URI, WHEATLEY, THALIA P · 2017 to 2021
$2.5M
NICHD NIH HHS DP1 HD091948NIMH NIH HHS R01 MH112566NINDS NIH HHS R01 NS109367
6 · The paper itself

Abstract

Departing from traditional linguistic models, advances in deep learning have resulted in a new type of predictive (autoregressive) deep language models (DLMs). Using a self-supervised next-word prediction task, these models generate appropriate linguistic responses in a given context. In the current study, nine participants listened to a 30-min podcast while their brain responses were recorded using electrocorticography (ECoG). We provide empirical evidence that the human brain and autoregressive DLMs share three fundamental computational principles as they process the same natural narrative: (1) both are engaged in continuous next-word prediction before word onset; (2) both match their pre-onset predictions to the incoming word to calculate post-onset surprise; (3) both rely on contextual embeddings to represent words in natural contexts. Together, our findings suggest that autoregressive DLMs provide a new and biologically feasible computational framework for studying the neural basis of language.

Indexed as

LanguageLinguisticsBrainHumans

Identifiers

PMID35260860
PMCPMC8904253
OpenAlexW4220949944

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.