ReviewCurrent opinion in neurobiology2020
Actor-critic reinforcement learning in the songbird.
Review in Current opinion in neurobiology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
26 citing papers in PubMed.
- Successful reinforcement history suppresses explicit and implicit error corrections.PLoS computational biology · 2026Article
- Bridging the divide in motor learning research.Nature human behaviour · 2026Review
- Striatal Dopamine at Learned Sequence Boundaries Sustains Birdsong.bioRxiv : the preprint server for biology · 2026Article
- PPO-GPR: A Custom Proximal Policy Optimization Tool for Active Reinforcement Learning.ACS engineering Au · 2026Article
- Hybrid neural-cognitive models reveal how memory shapes human reward learning.Nature human behaviour · 2026Article
- Acetylcholine demixes heterogeneous dopamine signals for learning and moving.Nature neuroscience · 2026Article
- Article
- Estrogen modulates reward prediction errors and reinforcement learning.Nature neuroscience · 2025Article
- Correctness is its own reward: bootstrapping error signals in self-guided reinforcement learning.bioRxiv : the preprint server for biology · 2025Article
- Comparative approaches to the neurobiology of avian vocal learning.Current opinion in neurobiology · 2025Review
- Article
- Neural mechanism of dopamine modulating singing related behavior in songbirds: an updated review.PeerJ · 2025Review
- Social context affects sequence modification learning in birdsong.Frontiers in psychology · 2025Article
- Weight Transfer in the Reinforcement Learning Model of Songbird Acquisition.bioRxiv : the preprint server for biology · 2024Article
- Daily singing of adult songbirds functions to maintain song performance independently of auditory feedback and age.Communications biology · 2024Article
- Artificial intelligence in pathologic diagnosis, prognosis and prediction of prostate cancer.American journal of clinical and experimental urology · 2024Review
- Effects of stochastic coding on olfactory discrimination in flies and mice.PLoS biology · 2023Article
- Feasibility of dopamine as a vector-valued feedback signal in the basal ganglia.Proceedings of the National Academy of Sciences of the United States of America · 2023Article
- An internal expectation guidesScience advances · 2022Article
- The neuroecology of the water-to-land transition and the evolution of the vertebrate brain.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
Abstract
It feels rewarding to ace your opponent on match point. Here, we propose common mechanisms underlie reward and performance learning. First, when a singing bird unexpectedly hits the right note, its dopamine (DA) neurons are activated as when a thirsty monkey receives an unexpected juice reward. Second, these DA signals reinforce vocal variations much as they reinforce stimulus-response associations. Third, limbic inputs to DA neurons signal the predicted quality of song syllables much like they signal the predicted reward value of a place or a stimulus during foraging. Finally, songbirds may solve difficult problems in reinforcement learning - such as credit assignment and catastrophic forgetting - with node perturbation and consolidation of reinforced vocal patterns in motor cortical circuits. Consolidation occurs downstream of a canonical 'actor-critic' circuit motif that learns to maximize performance quality in essentially the same way it learns to maximize reward: by computing and learning from prediction errors.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.