ArticleFrontiers in behavioral neuroscience2019
Separating Probability and Reversal Learning in a Novel Probabilistic Reversal Learning Task for Mice.
Article in Frontiers in behavioral neuroscience, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
19 citing papers in PubMed, 1 synthesis or guideline pooled it.
- A review on exploration-exploitation trade-off in psychiatric disorders.BMC psychiatry · 2025Pooled it
- Ventral striatal astrocytes contribute to reinforcement learning.bioRxiv : the preprint server for biology · 2025Article
- Acute isolation is associated with increased reward seeking and reward learning in human adolescents.Communications psychology · 2025Article
- Design and validation of novel brain-penetrant HCN channel inhibitors to ameliorate social stress-induced susceptible phenotype.Molecular psychiatry · 2025Article
- Transient DREADD Manipulation of the Dorsal Dentate Gyrus in Rats Impairs Initial Learning of Place-Outcome Associations.Hippocampus · 2025Article
- Characterisation of behaviours relevant to apathy syndrome in the aged male rat.Behavioural brain research · 2024Article
- Rodent tests of depression and anxiety: Construct validity and translational relevance.Cognitive, affective & behavioral neuroscience · 2024Review
- Article
- Activity in the Dorsomedial Striatum Underlies Serial Reversal Learning Performance Under Probabilistic Uncertainty.Biological psychiatry global open science · 2023Article
- Reinforcement learning deficits exhibited by postnatal PCP-treated rats enable deep neural network classification.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2023Article
- CADM2 is implicated in impulsive personality and numerous other traits by genome- and phenome-wide association studies in humans and mice.Translational psychiatry · 2023Article
- Modulation of ventromedial orbitofrontal cortical glutamatergic activity affects the explore-exploit balance and influences value-based decision-making.Cerebral cortex (New York, N.Y. : 1991) · 2023Article
- Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal.Developmental cognitive neuroscience · 2022Article
- Phasic Dopamine Changes and Hebbian Mechanisms during Probabilistic Reversal Learning in Striatal Circuits: A Computational Study.International journal of molecular sciences · 2022Article
- Cognitive flexibility in the wild: Individual differences in reversal learning are explained primarily by proactive interference, not by sampling strategies, in two passerine bird species.Learning & behavior · 2022Article
- Noradrenergic regulation of two-armed bandit performance.Behavioral neuroscience · 2022Article
- Reinforcement learning modeling reveals a reward-history-dependent strategy underlying reversal learning in squirrel monkeys.Behavioral neuroscience · 2022Article
- Trauma Disrupts Reinforcement Learning in Rats-A Novel Animal Model of Chronic Stress Exposure.Frontiers in behavioral neuroscience · 2022Article
- Sustained MK-801 induced deficit in a novel probabilistic reversal learning task.Frontiers in pharmacology · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
9 authors.
Funding
Abstract
The exploration/exploitation tradeoff - pursuing a known reward vs. sampling from lesser known options in the hope of finding a better payoff - is a fundamental aspect of learning and decision making. In humans, this has been studied using multi-armed bandit tasks. The same processes have also been studied using simplified probabilistic reversal learning (PRL) tasks with binary choices. Our investigations suggest that protocols previously used to explore PRL in mice may prove beyond their cognitive capacities, with animals performing at a no-better-than-chance level. We sought a novel probabilistic learning task to improve behavioral responding in mice, whilst allowing the investigation of the exploration/exploitation tradeoff in decision making. To achieve this, we developed a two-lever operant chamber task with levers corresponding to different probabilities (high/low) of receiving a saccharin reward, reversing the reward contingencies associated with levers once animals reached a threshold of 80% responding at the high rewarding lever. We found that, unlike in existing PRL tasks, mice are able to learn and behave near optimally with 80% high/20% low reward probabilities. Altering the reward contingencies towards equality showed that some mice displayed preference for the high rewarding lever with probabilities as close as 60% high/40% low. Additionally, we show that animal choice behavior can be effectively modelled using reinforcement learning (RL) models incorporating learning rates for positive and negative prediction error, a perseveration parameter, and a noise parameter. This new decision task, coupled with RL analyses, advances access to investigate the neuroscience of the exploration/exploitation tradeoff in decision making.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.