ReviewCurrent opinion in neurobiology2021
Dopamine signals as temporal difference errors: recent advances.
Review in Current opinion in neurobiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06484088 (Characterizing the Brain Circuitry and Neural Activity Mediating Frustration), which is not on this map. Cited by 36 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Characterizing the Brain Circuitry and Neural Activity Mediating Frustration
Who cites it
36 citing papers in PubMed.
- Reward Prediction Errors Drive Reinforcement Learning and Recognition Memory: Gender Differences in Methamphetamine Abusers.Brain and behavior · 2026Article
- Dopamine Dynamics in the Nucleus Accumbens Reflect Confidence in Detecting the Occurrence and Nonoccurrence of Visual Signals in Perceptual Decision-Making.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2026Article
- Rapid dopaminergic signatures in movement: Reach vigor reflects reward prediction error and learned expectation.Science advances · 2026Article
- Dopamine Responses in Medial Frontal Cortex Are More Consistent with a Generalized Arousal Signal Than Signed Reward Prediction Errors.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2026Article
- Motivation, attention, and uncertainty: insights from animal and human research and implications for addiction.Frontiers in psychology · 2026Review
- Constructing biologically constrained RNNs via Dale's backpropagation and topologically informed pruning.Science advances · 2025Article
- Reconciling time and prediction error theories of associative learning.Nature communications · 2025Article
- Sensitive dLight3 for imaging broad-spectrum dopamine events across brain regions.Research square · 2025Article
- Blinking indexes dynamic attending during and after music listening.Scientific reports · 2025Article
- Article
- Nucleus accumbens dopamine release reflects Bayesian inference during instrumental learning.PLoS computational biology · 2025Article
- Prospective contingency explains behavior and dopamine signals during associative learning.Nature neuroscience · 2025Article
- Rapid Dopaminergic Signatures in Movement: Reach Vigor Reflects Reward Prediction Error and Learned Expectation.bioRxiv : the preprint server for biology · 2025Article
- The curious case of dopaminergic prediction errors and learning associative information beyond value.Nature reviews. Neuroscience · 2025Review
- Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning.PLoS computational biology · 2025Article
- Complementary roles of serotonin and dopamine in model-based learning.Current opinion in behavioral sciences · 2025Article
- CONSTRUCTING BIOLOGICALLY CONSTRAINED RNNS VIA DALE'S BACKPROP AND TOPOLOGICALLY-INFORMED PRUNING.bioRxiv : the preprint server for biology · 2025Article
- Weber-Fechner law in temporal difference learning derived from control as inference.Frontiers in robotics and AI · 2025Article
- Expectancy-related changes in firing of dopamine neurons depend on hippocampus.Nature communications · 2024Article
- Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
Abstract
In the brain, dopamine is thought to drive reward-based learning by signaling temporal difference reward prediction errors (TD errors), a 'teaching signal' used to train computers. Recent studies using optogenetic manipulations have provided multiple pieces of evidence supporting that phasic dopamine signals function as TD errors. Furthermore, novel experimental results have indicated that when the current state of the environment is uncertain, dopamine neurons compute TD errors using 'belief states' or a probability distribution over potential states. It remains unclear how belief states are computed but emerging evidence suggests involvement of the prefrontal cortex and the hippocampus. These results refine our understanding of the role of dopamine in learning and the algorithms by which dopamine functions in the brain.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.