ArticlePLoS computational biology2016
Learning Reward Uncertainty in the Basal Ganglia.
Article in PLoS computational biology, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 53 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
53 citing papers in PubMed.
- Gambling on an empty stomach: Hunger modulates preferences for learned but not described risks.Brain and behavior · 2023Trial
- Dopamine Receptor-Specific Contributions to the Computation of Value.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2018Trial
- How the dynamic interplay of cortico-basal ganglia-thalamic pathways shapes the time course of deliberation and commitment.PLoS computational biology · 2026Article
- Asymmetric learning and adaptability to changes in relational structure during transitive inference.Communications psychology · 2025Article
- Article
- Distinct dopaminergic spike-timing-dependent plasticity rules are suited to different functional roles.Research square · 2025Article
- Article
- Striatal Gradient in Value-Decay Explains Regional Differences in Dopamine Patterns and Reinforcement Learning Computations.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025Article
- Tonic dopamine and biases in value learning linked through a biologically inspired reinforcement learning model.Nature communications · 2025Article
- Distinct dopaminergic spike-timing-dependent plasticity rules are suited to different functional roles.bioRxiv : the preprint server for biology · 2025Article
- From avoidance to new action: the multifaceted role of the striatal indirect pathway.Nature reviews. Neuroscience · 2025Review
- Article
- Many roads to minimizing regret: A comparison of Wang et al (2024) and OpAL* models of adaptive striatal dopamine.PLoS computational biology · 2025Article
- Article
- Arkypallidal neurons in the external globus pallidus can mediate inhibitory control by altering competition in the striatum.Proceedings of the National Academy of Sciences of the United States of America · 2024Article
- Reward Bases: A simple mechanism for adaptive acquisition of multiple reward types.PLoS computational biology · 2024Article
- D2 dopamine receptor expression, reactivity to rewards, and reinforcement learning in a complex value-based decision-making task.Social cognitive and affective neuroscience · 2024Article
- Reward prediction error neurons implement an efficient code for reward.Nature neuroscience · 2024Article
- Uncertainty of treatment efficacy moderates placebo effects on reinforcement learning.Scientific reports · 2024Article
- Dopamine encoding of novelty facilitates efficient uncertainty-driven exploration.PLoS computational biology · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
Abstract
Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid) options with variable reward can be controlled by increasing (or decreasing) the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.