Evidence map›Paper›PMID 38553456›Full record

ArticleNature communications2024

Alignment of brain embeddings and artificial contextual embeddings in natural language points to common geometric patterns.

Ariel Goldstein, Avigail Grinstein-Dabush, Mariano Schain, Haocheng Wang, Zhuoqiao Hong, Bobbi Aubrey, Samuel A Nastase, Zaid Zada, Eric Ham, Amir Feder and 12 more

Erratum issuedOpen access · goldAbstract read
In one paragraph

Article in Nature communications, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 30 papers.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed
36.0field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed, 56 citations in OpenAlex.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Overlapping Cortical Substrate of Biomechanical Control and Subjective Agency.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025
    Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

22 authors at 6 institutions in 2 countries.

Ariel GoldsteinBusiness School, Data Science department and Cognitive Department, Hebrew University, Jerusalem, Israel. ariel.y.goldstein@mail.huji.ac.il.ORCID http://orcid.org/0000-0003-4017-3363
Avigail Grinstein-Dabush *Google Research, Tel Aviv, Israel.
Mariano Schain *Google Research, Tel Aviv, Israel.
Haocheng WangDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Zhuoqiao HongDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Bobbi AubreyDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Samuel A NastaseDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0001-7013-5275
Zaid ZadaDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.ORCID http://orcid.org/0000-0002-3096-0059
Eric HamDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Amir FederGoogle Research, Tel Aviv, Israel.
Harshvardhan GazulaDepartment of Psychology and the Neuroscience Institute, Princeton University, Princeton, NJ, USA.
Eliav BuchnikGoogle Research, Tel Aviv, Israel.
Werner DoyleNew York University Grossman School of Medicine, New York, NY, USA.
Sasha DevoreNew York University Grossman School of Medicine, New York, NY, USA.
Patricia DuganNew York University Grossman School of Medicine, New York, NY, USA.
Roi ReichartFaculty of Industrial Engineering and Management, Technion, Israel Institute of Technology, Haifa, Israel.
Daniel FriedmanNew York University Grossman School of Medicine, New York, NY, USA.
Michael BrennerGoogle Research, Tel Aviv, Israel.
Avinatan HassidimGoogle Research, Tel Aviv, Israel.
Orrin DevinskyNew York University Grossman School of Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0003-0044-4632
Adeen FlinkerNew York University Grossman School of Medicine, New York, NY, USA.ORCID http://orcid.org/0000-0003-1247-1283
Uri HassonGoogle Research, Tel Aviv, Israel.ORCID http://orcid.org/0000-0002-3599-7168
Princeton University · USNew York University · USGoogle (Israel) · ILHarvard University · USHebrew University of Jerusalem · ILTechnion – Israel Institute of Technology · IL

Funding

Speaker-listener coupling: a novel neural approach for assessing communicationDP1HD091948 · NICHD · PRINCETON UNIVERSITY · PI HASSON, URI · 2016 to 2021
$5.6M
Spatiotemporal Organization of the Inferior Frontal Gyrus During Speech Production - Resubmission - 1R01NS109367 · NINDS · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI FLINKER, ADEEN · 2019 to 2023
$2.8M
Brain-to-brain dynamical Coupling: A New framework for the communication of social knowledgeR01MH112566 · NIMH · PRINCETON UNIVERSITY · PI HASSON, URI, WHEATLEY, THALIA P · 2017 to 2021
$2.5M
NICHD NIH HHS DP1 HD091948NIMH NIH HHS R01 MH112566NINDS NIH HHS R01 NS109367
6 · The paper itself

Abstract

Contextual embeddings, derived from deep language models (DLMs), provide a continuous vectorial representation of language. This embedding space differs fundamentally from the symbolic representations posited by traditional psycholinguistics. We hypothesize that language areas in the human brain, similar to DLMs, rely on a continuous embedding space to represent language. To test this hypothesis, we densely record the neural activity patterns in the inferior frontal gyrus (IFG) of three participants using dense intracranial arrays while they listened to a 30-minute podcast. From these fine-grained spatiotemporal neural recordings, we derive a continuous vectorial representation for each word (i.e., a brain embedding) in each patient. Using stringent zero-shot mapping we demonstrate that brain embeddings in the IFG and the DLM contextual embedding space have common geometric patterns. The common geometric patterns allow us to predict the brain embedding in IFG of a given left-out word based solely on its geometrical relationship to other non-overlapping words in the podcast. Furthermore, we show that contextual embeddings capture the geometry of IFG embeddings better than static word embeddings. The continuous brain embedding space exposes a vector-based neural code for natural language processing in the human brain.

Indexed as

BrainLanguageHumansNatural Language ProcessingPrefrontal Cortex

Identifiers

PMID38553456
PMCPMC10980748
OpenAlexW4393343917

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.