Evidence map›Paper›PMID 38508911›Full record

ReviewTrends in cognitive sciences2024

Dissociating language and thought in large language models.

Kyle Mahowald, Anna A Ivanova, Idan A Blank, Nancy Kanwisher, Joshua B Tenenbaum, Evelina Fedorenko

Abstract readReview
In one paragraph

Review in Trends in cognitive sciences, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 80 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
80citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

80 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Estimating the threat of AI-agent responding across online survey platforms.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  4. The Missing Dimension in Cancer Education: Developmental Meaning-Making and the Expert's Illusion of Symmetry.Journal of cancer education : the official journal of the American Association for Cancer Education · 2026
    Review
  5. Review
  6. Article
  7. Review
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. TechnologicalNature. Mental health · 2026
    Article
  14. Article
  15. Review
  16. Article
  17. Knowledge in Animals and Machines.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2026
    Article
  18. A Suite of LMs Comprehend Puzzle Statements as Well or Better Than Humans.Open mind : discoveries in cognitive science · 2026
    Article
  19. Article
  20. Article

20 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Kyle MahowaldThe University of Texas at Austin, Austin, TX, USA. Electronic address: mahowald@utexas.edu.
Anna A IvanovaGeorgia Institute of Technology, Atlanta, GA, USA. Electronic address: a.ivanova@gatech.edu.
Idan A BlankUniversity of California, Los Angeles, CA, USA. Electronic address: iblank@psych.ucla.edu.
Nancy KanwisherMassachusetts Institute of Technology, Cambridge, MA, USA. Electronic address: ngk@mit.edu.
Joshua B TenenbaumMassachusetts Institute of Technology, Cambridge, MA, USA. Electronic address: jbt@mit.edu.
Evelina FedorenkoMassachusetts Institute of Technology, Cambridge, MA, USA. Electronic address: evelina9@mit.edu.

Funding

Computational Neuroscience of Language Processing in the Human BrainU01NS121471 · NINDS · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI FEDORENKO, EVELINA, RICHARDSON, ROBERT MARK · 2021 to 2025
$3.2M
Functional reorganization of the language and domain-general multiple demand systems in aphasiaR01DC016950 · NIDCD · BOSTON UNIVERSITY (CHARLES RIVER CAMPUS) · PI FEDORENKO, EVELINA, KIRAN, SWATHI · 2019 to 2023
$3.2M
The neural architecture of pragmatic processingR01DC016607 · NIDCD · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI FEDORENKO, EVELINA · 2018 to 2022
$2.4M
NIDCD NIH HHS R01 DC016607NIDCD NIH HHS R01 DC016950NINDS NIH HHS U01 NS121471
6 · The paper itself

Abstract

Large language models (LLMs) have come closest among all models to date to mastering human language, yet opinions about their linguistic and cognitive capabilities remain split. Here, we evaluate LLMs using a distinction between formal linguistic competence (knowledge of linguistic rules and patterns) and functional linguistic competence (understanding and using language in the world). We ground this distinction in human neuroscience, which has shown that formal and functional competence rely on different neural mechanisms. Although LLMs are surprisingly good at formal competence, their performance on functional competence tasks remains spotty and often requires specialized fine-tuning and/or coupling with external modules. We posit that models that use language in human-like ways would need to master both of these competence types, which, in turn, could require the emergence of separate mechanisms specialized for formal versus functional linguistic competence.

Indexed as

LanguageHumansLinguisticsThinkingcognitive neurosciencecomputational modelinglanguage and thoughtlarge language modelslinguistic competence

Identifiers

PMID38508911
PMCPMC11416727

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.