ArticleLearning & memory (Cold Spring Harbor, N.Y.)2016
Active Inference, epistemic value, and vicarious trial and error.
Article in Learning & memory (Cold Spring Harbor, N.Y.), 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
21 citing papers in PubMed.
- The modal-modular model of animal self-representation: a comparative and operational framework.Frontiers in psychology · 2026Article
- Uncertainty minimization and pattern recognition inJournal of the Royal Society, Interface · 2025Article
- Space is a latent sequence: A theory of the hippocampus.Science advances · 2024Article
- The 3Ps: A tool for coach observation.Frontiers in sports and active living · 2022Article
- From exploration to exploitation: a shifting mental mode in late life development.Trends in cognitive sciences · 2021Review
- Clone-structured graph representations enable flexible learning and vicarious evaluation of cognitive maps.Nature communications · 2021Article
- Consciousness in active inference: Deep self-models, other minds, and the challenge of psychedelic-induced ego-dissolution.Neuroscience of consciousness · 2021Review
- Presence, flow, and narrative absorption: an interdisciplinary theoretical exploration with a new spatiotemporal integrated model based on predictive processing.Open research Europe · 2021Article
- The hierarchically mechanistic mind: an evolutionary systems theory of the human brain, cognition, and behavior.Cognitive, affective & behavioral neuroscience · 2019Review
- Caching mechanisms for habit formation in Active Inference.Neurocomputing · 2019Article
- Making the Environment an Informative Place: A Conceptual Analysis of Epistemic Policies and Sensorimotor Coordination.Entropy (Basel, Switzerland) · 2019Article
- Model-based spatial navigation in the hippocampus-ventral striatum circuit: A computational analysis.PLoS computational biology · 2018Article
- Hierarchical Active Inference: A Theory of Motivated Control.Trends in cognitive sciences · 2018Review
- Reconsidering the Mind-Wandering Reader: Predictive Processing, Probability Designs, and Enculturation.Frontiers in psychology · 2018Article
- Commentary: The Problem of Mental Action: Predictive Control Without Sensory Sheets.Frontiers in psychology · 2018Article
- Fatigue modulates dopamine availability and promotes flexible choice reversals during decision making.Scientific reports · 2017Article
- Action perception as hypothesis testing.Cortex; a journal devoted to the study of the nervous system and behavior · 2017Article
- A Goal-Directed Bayesian Framework for Categorization.Frontiers in psychology · 2017Article
- Top-down models in biology: explanation and control of complex living systems above the molecular level.Journal of the Royal Society, Interface · 2016Review
- Active inference and learning.Neuroscience and biobehavioral reviews · 2016Review
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
Abstract
Balancing habitual and deliberate forms of choice entails a comparison of their respective merits-the former being faster but inflexible, and the latter slower but more versatile. Here, we show that arbitration between these two forms of control can be derived from first principles within an Active Inference scheme. We illustrate our arguments with simulations that reproduce rodent spatial decisions in T-mazes. In this context, deliberation has been associated with vicarious trial and error (VTE) behavior (i.e., the fact that rodents sometimes stop at decision points as if deliberating between choice alternatives), whose neurophysiological correlates are "forward sweeps" of hippocampal place cells in the arms of the maze under consideration. Crucially, forward sweeps arise early in learning and disappear shortly after, marking a transition from deliberative to habitual choice. Our simulations show that this transition emerges as the optimal solution to the trade-off between policies that maximize reward or extrinsic value (habitual policies) and those that also consider the epistemic value of exploratory behavior (deliberative or epistemic policies)-the latter requiring VTE and the retrieval of episodic information via forward sweeps. We thus offer a novel perspective on the optimality principles that engender forward sweeps and VTE, and on their role on deliberate choice.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.