ArticleScientific reports2017
Learning the value of information and reward over time when solving exploration-exploitation problems.
Article in Scientific reports, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 28 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
28 citing papers in PubMed.
- Representations of the intrinsic value of information in mouse orbitofrontal cortex.Nature neuroscience · 2026Article
- Exerting effort for non-instrumental information under risk.Scientific reports · 2026Article
- The road not taken: selective sampling and persisting inaccurate impressions.Motivation and emotion · 2026Article
- Pupil size response within direct and random exploration and exploitation behaviors selectively reflects value of control.Frontiers in psychology · 2026Article
- Different exploration strategies along the autism spectrum: diverging effects of autism diagnosis and autism traits.Molecular autism · 2025Article
- Meta-Analysis Reveals That Explore-Exploit Decisions are Dissociable by Activation in the Dorsal Lateral Prefrontal Cortex, Anterior Insula, and the Dorsal Anterior Cingulate Cortex.bioRxiv : the preprint server for biology · 2025Article
- Information seeking and the expected utility of information about COVID-19 can be associated with uncertainty and related attitudes.Scientific reports · 2025Article
- Signatures of Perseveration and Heuristic-Based Directed Exploration in Two-Step Sequential Decision Task Behaviour.Computational psychiatry (Cambridge, Mass.) · 2025Article
- Fluctuations in Sequential Many-Alternative Decisions Reveal Strategies Beyond Immediate Reward Maximisation.Journal of cognition · 2025Article
- Multiple and subject-specific roles of uncertainty in reward-guided decision-making.bioRxiv : the preprint server for biology · 2024Article
- The roles of intrinsic motivation and capability-related factors in cognitive effort-based decision-making.Frontiers in psychology · 2024Article
- Losses resulting from deliberate exploration trigger beta oscillations in frontal cortex.Frontiers in neuroscience · 2023Article
- People adaptively use information to improve their internal states and external outcomes.Cognition · 2022Article
- Active inference and the two-step task.Scientific reports · 2022Article
- Pupil dilation and response slowing distinguish deliberate explorative choices in the probabilistic learning task.Cognitive, affective & behavioral neuroscience · 2022Article
- Independent and interacting value systems for reward and information in the human brain.eLife · 2022Article
- From exploration to exploitation: a shifting mental mode in late life development.Trends in cognitive sciences · 2021Review
- Distinct motivations to seek out information in healthy individuals and problem gamblers.Translational psychiatry · 2021Article
- Revisiting the Role of Uncertainty-Driven Exploration in a (Perceived) Non-Stationary World.CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference · 2021Article
- Meta-control of the exploration-exploitation dilemma emerges from probabilistic inference over a hierarchy of time scales.Cognitive, affective & behavioral neuroscience · 2021Article
Corrections and comments
- Erratum issued
Authors and funding
4 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
To flexibly adapt to the demands of their environment, animals are constantly exposed to the conflict resulting from having to choose between predictably rewarding familiar options (exploitation) and risky novel options, the value of which essentially consists of obtaining new information about the space of possible rewards (exploration). Despite extensive research, the mechanisms that subtend the manner in which animals solve this exploitation-exploration dilemma are still poorly understood. Here, we investigate human decision-making in a gambling task in which the informational value of each trial and the reward potential were separately manipulated. To better characterize the mechanisms that underlined the observed behavioural choices, we introduce a computational model that augments the standard reward-based reinforcement learning formulation by associating a value to information. We find that both reward and information gained during learning influence the balance between exploitation and exploration, and that this influence was dependent on the reward context. Our results shed light on the mechanisms that underpin decision-making under uncertainty, and suggest new approaches for investigating the exploration-exploitation dilemma throughout the animal kingdom.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.