Evidence map›Paper›PMID 38394198›Full record

ArticleScience advances2024

Reward-based option competition in human dorsal stream and transition from stochastic exploration to exploitation in continuous space.

Michael N Hallquist, Kai Hwang, Beatriz Luna, Alexandre Y Dombrovski

Abstract read
In one paragraph

Article in Science advances, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Spatiotemporal Decoding of Explore-Exploit Decisions in the Human Brain.bioRxiv : the preprint server for biology · 2026
    Article
  2. Prefrontal Default Mode Network Interactions with Posterior Hippocampus during Exploration.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Michael N HallquistDepartment of Psychology, University of North Carolina, Chapel Hill, NC, USA.ORCID 0000-0001-5894-8038
Kai HwangDepartment of Psychological and Brain Sciences, Iowa Neuroscience Institute, University of Iowa, Iowa City, IA, USA.
Beatriz LunaDepartment of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA.ORCID 0000-0002-9929-2458
Alexandre Y DombrovskiDepartment of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA.ORCID 0000-0002-2054-4772

Funding

University of Iowa Hawkeye Intellectual and Developmental Disabilities Research Center (Hawk-IDDRC)P50HD103556 · NICHD · UNIVERSITY OF IOWA · PI EDWIN TED G. ABEL, Lane Strathearn · 2021 to 2026
$8.5M
Reward Learning in Late-Life Suicidal BehaviorR01MH100095 · NIMH · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI Alexandre Y. Dombrovski · 2014 to 2026
$6.8M
Methods for MR Guided Interventions in Coronary VesselsR01HL067924 · NHLBI · WASHINGTON UNIVERSITY · PI TSEKOS, NIKOLAOS V · 2003 to 2006
$1.5M
Neurodevelopmental Origins of Emotion Dysregulation in Borderline PersonalityK01MH097091 · NIMH · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI HALLQUIST, MICHAEL NELSON · 2013 to 2016
$620k
NHLBI NIH HHS R01 HL067924NICHD NIH HHS P50 HD103556NIMH NIH HHS K01 MH097091NIMH NIH HHS R01 MH100095
6 · The paper itself

Abstract

Primates exploring and exploiting a continuous sensorimotor space rely on dynamic maps in the dorsal stream. Two complementary perspectives exist on how these maps encode rewards. Reinforcement learning models integrate rewards incrementally over time, efficiently resolving the exploration/exploitation dilemma. Working memory buffer models explain rapid plasticity of parietal maps but lack a plausible exploration/exploitation policy. The reinforcement learning model presented here unifies both accounts, enabling rapid, information-compressing map updates and efficient transition from exploration to exploitation. As predicted by our model, activity in human frontoparietal dorsal stream regions, but not in MT+, tracks the number of competing options, as preferred options are selectively maintained on the map, while spatiotemporally distant alternatives are compressed out. When valuable new options are uncovered, posterior β

Indexed as

Reinforcement, PsychologyRewardAnimalsHumansLearningMemory, Short-Term

Identifiers

PMID38394198
PMCPMC10889364

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.