Evidence map›Paper›PMID 34354249›Full record

ReviewNeuropsychopharmacology : official publication of the American College of Neuropsychopharmacology2022

Reinforcement-learning in fronto-striatal circuits.

Bruno Averbeck, John P O'Doherty

Open access · bronzeAbstract readReview
In one paragraph

Review in Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 68 papers.

0numbers the graph read from it
0cells of the map it votes in
68citing papers in PubMed
10.5field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

68 citing papers in PubMed, 133 citations in OpenAlex.

  1. Trial
  2. Trial
  3. Article
  4. Long-term Learning Induces Plastic Changes in Frontostriatal Circuits.bioRxiv : the preprint server for biology · 2026
    Article
  5. Article
  6. Review
  7. Article
  8. Contributions of the basolateral amygdala and nucleus accumbens to sustaining not just initiating cognitive effort.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  9. Article
  10. Prefrontal Mechanisms of Rule Learning.bioRxiv : the preprint server for biology · 2026
    Article
  11. An emerging role for synaptic ZnPharmacology & therapeutics · 2026
    Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Ventral striatal astrocytes contribute to reinforcement learning.bioRxiv : the preprint server for biology · 2025
    Article
  20. Article

8 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors at 2 institutions in 2 countries.

Bruno AverbeckNational Institute of Mental Health, Bethesda, MD, USA. averbeckbb@mail.nih.gov.ORCID http://orcid.org/0000-0002-3976-8565
John P O'DohertyDivision of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA. jdoherty@caltech.edu.
California Institute of Technology · USNational Institute of Mental Health · US

Funding

Frontal Striatal Systems and Dopamine in Normal and Pathological BehaviorZIAMH002928 · NIMH · NATIONAL INSTITUTE OF MENTAL HEALTH · PI AVERBECK, BRUNO · 2010 to 2025
$29.0M
The Neurobiology of Social Decision-Making: Social Inference and ContextP50MH094258 · NIMH · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI ANDERSEN, RICHARD A · 2012 to 2021
$18.6M
Neuronal Substrates of Hemodynamic Signals in the Prefrontal CortexR01MH111425 · NIMH · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI HOWARD, MATTHEW A., O'DOHERTY, JOHN P · 2016 to 2020
$3.6M
Determining the explanatory utility of computational reinforcement-learning theories of goal-directed and habitual control at behavioral and neural levelsR01MH121089 · NIMH · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI O'DOHERTY, JOHN P · 2019 to 2023
$3.5M
Determining the neural substrates of model-based and model-free reinforcement-learning during Pavlovian conditioning (Minority Supplement)R01DA040011 · NIDA · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI O'DOHERTY, JOHN P · 2016 to 2020
$2.6M
Toward a High Dimensional Computational Description of Variation in Human Decision-Making Across Psychiatric and Non-Psychiatric PopulationsR21MH120805 · NIMH · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI O'DOHERTY, JOHN P · 2019 to 2020
$464k
NIDA NIH HHS R01 DA040011NIMH NIH HHS P50 MH094258NIMH NIH HHS R01 MH111425NIMH NIH HHS R01 MH121089NIMH NIH HHS R21 MH120805
6 · The paper itself

Abstract

We review the current state of knowledge on the computational and neural mechanisms of reinforcement-learning with a particular focus on fronto-striatal circuits. We divide the literature in this area into five broad research themes: the target of the learning-whether it be learning about the value of stimuli or about the value of actions; the nature and complexity of the algorithm used to drive the learning and inference process; how learned values get converted into choices and associated actions; the nature of state representations, and of other cognitive machinery that support the implementation of various reinforcement-learning operations. An emerging fifth area focuses on how the brain allocates or arbitrates control over different reinforcement-learning sub-systems or "experts". We will outline what is known about the role of the prefrontal cortex and striatum in implementing each of these functions. We then conclude by arguing that it will be necessary to build bridges from algorithmic level descriptions of computational reinforcement-learning to implementational level models to better understand how reinforcement-learning emerges from multiple distributed neural networks in the brain.

Indexed as

LearningReinforcement, PsychologyBrain MappingCorpus StriatumPrefrontal Cortex

Identifiers

PMID34354249
PMCPMC8616931
OpenAlexW3192769286

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.