Evidence map›Paper›PMID 37611585›Full record

ArticleNeuron2023

Dual credit assignment processes underlie dopamine signals in a complex spatial environment.

Timothy A Krausz, Alison E Comrie, Ari E Kahn, Loren M Frank, Nathaniel D Daw, Joshua D Berke

Open access · hybridAbstract read
In one paragraph

Article in Neuron, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed
10.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 60 citations in OpenAlex.

  1. Sequence termination cues drive automated habit-like strategy via dopamine-mediated processes.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Meta-learning is expressed through altered prefrontal cortical dynamics.bioRxiv : the preprint server for biology · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Trial-by-trial learning of successor representations in human behavior.bioRxiv : the preprint server for biology · 2025
    Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Striatal Gradient in Value-Decay Explains Regional Differences in Dopamine Patterns and Reinforcement Learning Computations.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025
    Article
  19. Article
  20. Prioritizing replay when future goals are unknown.bioRxiv : the preprint server for biology · 2025
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Timothy A KrauszNeuroscience Graduate Program, University of California, San Francisco, San Francisco, CA 94158, USA.
Alison E ComrieNeuroscience Graduate Program, University of California, San Francisco, San Francisco, CA 94158, USA.
Ari E KahnDepartment of Psychology, and Princeton Neuroscience Institute, Princeton University, Princeton, Princeton, NJ 08544, USA.
Loren M FrankNeuroscience Graduate Program, University of California, San Francisco, San Francisco, CA 94158, USA; Howard Hughes Medical Institute, Chevy Chase, MD 20815, USA; Department of Physiology, University of California, San Francisco, San Francisco, CA 94158, USA.
Nathaniel D DawDepartment of Psychology, and Princeton Neuroscience Institute, Princeton University, Princeton, Princeton, NJ 08544, USA.
Joshua D BerkeNeuroscience Graduate Program, University of California, San Francisco, San Francisco, CA 94158, USA; Kavli Institute for Fundamental Neuroscience, and Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA 94158, USA; Department of Neurology and Department of Psychiatry and Behavioral Science, University of California, San Francisco, San Francisco, CA 94158, USA. Electronic address: joshua.berke@ucsf.edu.
University of California, San Francisco · USPrinceton University · US

Funding

Dopaminergic mechanisms for motivation and reinforcement learningR01DA045783 · NIDA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI JOSHUA D BERKE · 2018 to 2026
$4.1M
Neural mechanisms linking need to rewardRF1NS116626 · NINDS · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI BERKE, JOSHUA D, KNIGHT, ZACHARY A. · 2020 to 2020
$2.7M
NIDA NIH HHS R01 DA045783NINDS NIH HHS RF1 NS116626
6 · The paper itself

Abstract

Animals frequently make decisions based on expectations of future reward ("values"). Values are updated by ongoing experience: places and choices that result in reward are assigned greater value. Yet, the specific algorithms used by the brain for such credit assignment remain unclear. We monitored accumbens dopamine as rats foraged for rewards in a complex, changing environment. We observed brief dopamine pulses both at reward receipt (scaling with prediction error) and at novel path opportunities. Dopamine also ramped up as rats ran toward reward ports, in proportion to the value at each location. By examining the evolution of these dopamine place-value signals, we found evidence for two distinct update processes: progressive propagation of value along taken paths, as in temporal difference learning, and inference of value throughout the maze, using internal models. Our results demonstrate that within rich, naturalistic environments dopamine conveys place values that are updated via multiple, complementary learning algorithms.

Indexed as

Decision MakingDopamineAnimalsBrainRatsRewardDopaminecredit assignmentdecision-makingdopaminemazenavigationreinforcement learning

Identifiers

PMID37611585
PMCPMC10841332
OpenAlexW4386074680

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.