Evidence map›Paper›PMID 39395170›Full record

ArticleCell reports2024

Dopamine transients encode reward prediction errors independent of learning rates.

Andrew Mah, Carla E M Golden, Christine M Constantinople

Abstract read
In one paragraph

Article in Cell reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Addressing degeneracy in rodent studies of cognition.Current opinion in neurobiology · 2026
    Review
  5. Article
  6. Article
  7. Article
  8. Dual cholinergic mechanisms for sculpting striatal dopamine in vivo.bioRxiv : the preprint server for biology · 2025
    Article
  9. Article
  10. Review
  11. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

3 authors.

Andrew MahCenter for Neural Science, New York University, New York, NY, USA.
Carla E M GoldenCenter for Neural Science, New York University, New York, NY, USA.
Christine M ConstantinopleCenter for Neural Science, New York University, New York, NY, USA. Electronic address: constantinople@nyu.edu.

Funding

Training Systems and Integrative NeuroscienceT32MH019524 · NIMH · NEW YORK UNIVERSITY · PI KIORPES, LYNNE · 1992 to 2025
$5.2M
Neural circuit mechanisms of arithmetic for economic decision-makingDP2MH126376 · NIMH · NEW YORK UNIVERSITY · PI CONSTANTINOPLE, CHRISTINE M · 2020 to 2020
$2.4M
Acetylcholine determines dopamine's role in learning versus movingR01MH136272 · NIMH · NEW YORK UNIVERSITY · PI Christine M Constantinople · 2024 to 2026
$1.8M
Neural mechanisms of probability estimation during decision-makingR00MH111926 · NIMH · NEW YORK UNIVERSITY · PI CONSTANTINOPLE, CHRISTINE M · 2019 to 2021
$901k
Training a new generation of computational neuroscientists bridging neurobiology and cognitionT90DA043219 · NIDA · NEW YORK UNIVERSITY · PI MA, WEI JI, WANG, XIAO-JING · 2016 to 2020
$615k
Orbitofrontal modulation of dopamine during value-based decision-makingF31MH130121 · NIMH · NEW YORK UNIVERSITY · PI MAH, ANDREW · 2022 to 2024
$70k
Hormonal regulation of value-based decision-makingF32MH125448 · NIMH · NEW YORK UNIVERSITY · PI GOLDEN, CARLA · 2020 to 2020
$50k
NIDA NIH HHS T90 DA043219NIMH NIH HHS DP2 MH126376NIMH NIH HHS F31 MH130121NIMH NIH HHS F32 MH125448NIMH NIH HHS R00 MH111926NIMH NIH HHS R01 MH136272NIMH NIH HHS T32 MH019524
6 · The paper itself

Abstract

Biological accounts of reinforcement learning posit that dopamine encodes reward prediction errors (RPEs), which are multiplied by a learning rate to update state or action values. These values are thought to be represented by corticostriatal synaptic weights, which are updated by dopamine-dependent plasticity. This suggests that dopamine release reflects the product of the learning rate and RPE. Here, we characterize dopamine encoding of learning rates in the nucleus accumbens core (NAcc) in a volatile environment. Using a task with semi-observable states offering different rewards, we find that rats adjust how quickly they initiate trials across states using RPEs. Computational modeling and behavioral analyses show that learning rates are higher following state transitions and scale with trial-by-trial changes in beliefs about hidden states, approximating normative Bayesian strategies. Notably, dopamine release in the NAcc encodes RPEs independent of learning rates, suggesting that dopamine-independent mechanisms instantiate dynamic learning rates.

Indexed as

DopamineLearningNucleus AccumbensRewardAnimalsBayes TheoremMaleRatsRats, Long-EvansRats, Sprague-DawleyDopaminechangepoint detectionCP: Neurosciencedopaminedynamic learning ratenucleus accumbens corereinforcement learning

Identifiers

PMID39395170
PMCPMC11571066

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.