ReviewCognitive, affective & behavioral neuroscience2014
Model-based and model-free Pavlovian reward learning: revaluation, revision, and revelation.
Review in Cognitive, affective & behavioral neuroscience, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 157 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
157 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- How childhood adversity affects components of decision making.Neuroscience and biobehavioral reviews · 2025Pooled it
- Reinforcement Learning Algorithms and Applications in Healthcare and Robotics: A Comprehensive and Systematic Review.Sensors (Basel, Switzerland) · 2024Pooled it
- Reward and avoidance learning in the context of aversive environments and possible implications for depressive symptoms.Psychopharmacology · 2019Trial
- Causal role of the inferolateral prefrontal cortex in balancing goal-directed and habitual control of behavior.Scientific reports · 2018Trial
- Trial
- Methamphetamine potentiates the use of outcome-specific associations via a hypothalamic-dopamine circuit.Neuron · 2026Article
- Can the incentive-sensitization theory of addiction incorporate addiction to opioid drugs?Psychopharmacology · 2026Review
- Model-Free and Model-Based Learning in Human Fear Conditioning.Psychophysiology · 2026Article
- A single reinforcement learning model to unify habit formation and Pavlovian-instrumental interaction.Scientific reports · 2026Article
- Article
- Motivation, attention, and uncertainty: insights from animal and human research and implications for addiction.Frontiers in psychology · 2026Review
- Atypical contributions of reward decisions to momentary mood in individuals with methamphetamine use disorder.BMC psychiatry · 2025Article
- On the origin of the reward function: Exploring the role of conditioned reinforcement and social learning.Psychonomic bulletin & review · 2025Review
- Phasic dopamine encodes persistent attraction to reward cues.bioRxiv : the preprint server for biology · 2025Article
- GWAS for behavioral traits in golden retrievers identifies genes implicated in human temperament, mental health, and cognition.Proceedings of the National Academy of Sciences of the United States of America · 2025Article
- Value-modulated attentional capture depends on awareness.Psychonomic bulletin & review · 2025Article
- Neural encoding of biomechanically (im)possible human movements in occipitotemporal cortex.PLoS computational biology · 2025Article
- The reward positivity is insensitive to reinforcer devaluation.Cognitive, affective & behavioral neuroscience · 2025Article
- 20 Years of Aberrant Salience in Psychosis: What Have We Learned?The American journal of psychiatry · 2025Review
- Selective engagement of prefrontal VIP neurons in reversal learning.Science advances · 2025Article
97 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
Abstract
Evidence supports at least two methods for learning about reward and punishment and making predictions for guiding actions. One method, called model-free, progressively acquires cached estimates of the long-run values of circumstances and actions from retrospective experience. The other method, called model-based, uses representations of the environment, expectations, and prospective calculations to make cognitive predictions of future value. Extensive attention has been paid to both methods in computational analyses of instrumental learning. By contrast, although a full computational analysis has been lacking, Pavlovian learning and prediction has typically been presumed to be solely model-free. Here, we revise that presumption and review compelling evidence from Pavlovian revaluation experiments showing that Pavlovian predictions can involve their own form of model-based evaluation. In model-based Pavlovian evaluation, prevailing states of the body and brain influence value computations, and thereby produce powerful incentive motivations that can sometimes be quite new. We consider the consequences of this revised Pavlovian view for the computational landscape of prediction, response, and choice. We also revisit differences between Pavlovian and instrumental learning in the control of incentive motivation.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.