Evidence map›Paper›PMID 42045182›Full record

ArticleNature communications2026

Spurious alignment between large language models and brains can emerge from non-robust methods and overlooked confounds.

Nima Hadidi, Ebrahim Feghhi, Bryan H Song, Idan A Blank, Jonathan C Kao

Abstract read
In one paragraph

Article in Nature communications, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Review
  2. The human language processing system straightens natural speech.bioRxiv : the preprint server for biology · 2026
    Article
  3. Sharpened Visual Memory Representations Are Reflected in Inferotemporal Cortex.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2026
    Article
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Nima Hadidi *Department of Electrical and Computer Engineering, University of California, Los Angeles, Los Angeles, CA, USA. nhadidi@g.ucla.edu.ORCID http://orcid.org/0009-0000-9521-2185
Ebrahim Feghhi *Department of Electrical and Computer Engineering, University of California, Los Angeles, Los Angeles, CA, USA. ebrahimfeghhi@g.ucla.edu.ORCID http://orcid.org/0000-0001-9491-0547
Bryan H SongDepartment of Computer Science, University of California, Los Angeles, Los Angeles, CA, USA.
Idan A BlankNeuroscience Interdepartmental Program, University of California, Los Angeles, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0001-7057-8391
Jonathan C KaoDepartment of Electrical and Computer Engineering, University of California, Los Angeles, Los Angeles, CA, USA.ORCID http://orcid.org/0000-0002-9298-0143

Funding

Foundation for the National Institutes of Health (Foundation for the National Institutes of Health, Inc.) R01NS121097National Science Foundation (NSF) 1943467
6 · The paper itself

Abstract

Emerging research seeks to draw neuroscientific insights from the neural predictivity of large language models (LLMs). However, as results rapidly proliferate, there is a growing need for large-scale assessments of their robustness. Here, we analyze a wide range of models and methodological approaches across three widely used neural datasets. We find that the use of shuffled train-test splits has contributed to findings that are influential but spurious. Furthermore, how activations are extracted from LLMs can bias results in favor of specific model classes. Lastly, we find that confounding variables, particularly positional signals and word rate, perform competitively with trained LLMs and fully account for the neural predictivity of untrained LLMs on these neural datasets. Although many studies in the field avoid these pitfalls, our results indicate that some apparent alignment between LLMs and brains has emerged from non-robust methods and overlooked confounds.

Indexed as

BrainLarge Language ModelsHumans

Identifiers

PMID42045182
PMCPMC13324000

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.