Evidence map›Paper›PMID 26019331›Full record

Trial reportThe Journal of neuroscience : the official journal of the Society for Neuroscience2015

Reinforcement learning in multidimensional environments relies on attention mechanisms.

Yael Niv, Reka Daniel, Andra Geana, Samuel J Gershman, Yuan Chang Leong, Angela Radulescu, Robert C Wilson

Open access · bronzeAbstract readRandomized Controlled Trial
In one paragraph

Trial report in The Journal of neuroscience : the official journal of the Society for Neuroscience, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 185 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
185citing papers in PubMed, 1 pooled it
16.8field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

185 citing papers in PubMed, 1 synthesis or guideline pooled it, 403 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Feasible cognition requires latent state.Biological cybernetics · 2026
    Article
  7. Review
  8. Article
  9. Frontoparietal Hub Connectivity Integrates Information from Multiple Sources.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Neural representations of beliefs in a multi-dimensional inference task.bioRxiv : the preprint server for biology · 2026
    Article
  17. Article
  18. Attentional Mechanisms for Learning Feature Combinations.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025
    Article
  19. Article
  20. Article

125 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

7 authors at 4 institutions in 1 country.

Yael NivDepartment of Psychology and Neuroscience Institute, Princeton University, Princeton, New Jersey 08540, yael@princeton.edu.ORCID http://orcid.org/0000-0002-0259-8371
Reka DanielDepartment of Psychology and Neuroscience Institute, Princeton University, Princeton, New Jersey 08540.ORCID http://orcid.org/0000-0003-3706-7623
Andra GeanaDepartment of Psychology and Neuroscience Institute, Princeton University, Princeton, New Jersey 08540.
Samuel J GershmanDepartment of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139.
Yuan Chang LeongDepartment of Psychology, Stanford University, Stanford, California 94305, and.
Angela RadulescuDepartment of Psychology and Neuroscience Institute, Princeton University, Princeton, New Jersey 08540.
Robert C WilsonDepartment of Psychology and Cognitive Science Program, University of Arizona, Tucson, Arizona 85721.
Princeton University · USMassachusetts Institute of Technology · USStanford University · USUniversity of Arizona · US

Funding

Neural and computational mechanisms of selective attention in experience-based deR01MH098861 · NIMH · PRINCETON UNIVERSITY · PI NIV, YAEL · 2012 to 2014
$1.1M
fMRI investigations of how we learn what is relevant for a decisionR03DA029073 · NIDA · PRINCETON UNIVERSITY · PI NIV, YAEL · 2011 to 2011
$242k
NIDA NIH HHS R03 DA029073NIDA NIH HHS R03DA029073NIMH NIH HHS R01 MH098861NIMH NIH HHS R01MH098861
6 · The paper itself

Abstract

In recent years, ideas from the computational field of reinforcement learning have revolutionized the study of learning in the brain, famously providing new, precise theories of how dopamine affects learning in the basal ganglia. However, reinforcement learning algorithms are notorious for not scaling well to multidimensional environments, as is required for real-world learning. We hypothesized that the brain naturally reduces the dimensionality of real-world problems to only those dimensions that are relevant to predicting reward, and conducted an experiment to assess by what algorithms and with what neural mechanisms this "representation learning" process is realized in humans. Our results suggest that a bilateral attentional control network comprising the intraparietal sulcus, precuneus, and dorsolateral prefrontal cortex is involved in selecting what dimensions are relevant to the task at hand, effectively updating the task representation through trial and error. In this way, cortical attention mechanisms interact with learning in the basal ganglia to solve the "curse of dimensionality" in reinforcement learning.

Indexed as

EnvironmentReinforcement, PsychologyAdolescentAdultAttentionChoice BehaviorFemaleHumansLearningMalePhotic StimulationYoung AdultattentionfMRIfrontoparietal networkmodel comparisonreinforcement learningrepresentation learning

Identifiers

PMID26019331
PMCPMC4444538
OpenAlexW1581202840

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.