Evidence map›Paper›PMID 26664702›Full record

ArticleF1000Research2015

Matching Behavior as a Tradeoff Between Reward Maximization and Demands on Neural Computation.

Jan Kubanek, Lawrence H Snyder

Abstract read
In one paragraph

Article in F1000Research, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Undermatching Is a Consequence of Policy Compression.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2023
    Article
  2. Article
  3. Optimal decision making and matching are tied through diminishing returns.Proceedings of the National Academy of Sciences of the United States of America · 2017
    Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Jan KubanekDepartment of Anatomy and Neurobiology, Washington University School of Medicine, St. Louis, MO, 63110, USA ; Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO, 63130, USA.
Lawrence H SnyderDepartment of Anatomy and Neurobiology, Washington University School of Medicine, St. Louis, MO, 63110, USA ; Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO, 63130, USA.

Funding

WASHINGTON UNIVERSITY CENTER VISION RESEARCHP30EY002687 · NEI · WASHINGTON UNIVERSITY · PI Philip Andrew Ruzycki · 1985 to 2026
$18.4M
VISUAL-MOTOR TRANSFORMATIONS IN PARIETAL CORTEXR01EY012135 · NEI · WASHINGTON UNIVERSITY · PI SNYDER, LAWRENCE H · 2000 to 2023
$8.4M
NEI NIH HHS P30 EY002687NEI NIH HHS R01 EY012135
6 · The paper itself

Abstract

When faced with a choice, humans and animals commonly distribute their behavior in proportion to the frequency of payoff of each option. Such behavior is referred to as matching and has been captured by the matching law. However, matching is not a general law of economic choice. Matching in its strict sense seems to be specifically observed in tasks whose properties make matching an optimal or a near-optimal strategy. We engaged monkeys in a foraging task in which matching was not the optimal strategy. Over-matching the proportions of the mean offered reward magnitudes would yield more reward than matching, yet, surprisingly, the animals almost exactly matched them. To gain insight into this phenomenon, we modeled the animals' decision-making using a mechanistic model. The model accounted for the animals' macroscopic and microscopic choice behavior. When the models' three parameters were not constrained to mimic the monkeys' behavior, the model over-matched the reward proportions and in doing so, harvested substantially more reward than the monkeys. This optimized model revealed a marked bottleneck in the monkeys' choice function that compares the value of the two options. The model featured a very steep value comparison function relative to that of the monkeys. The steepness of the value comparison function had a profound effect on the earned reward and on the level of matching. We implemented this value comparison function through responses of simulated biological neurons. We found that due to the presence of neural noise, steepening the value comparison requires an exponential increase in the number of value-coding neurons. Matching may be a compromise between harvesting satisfactory reward and the high demands placed by neural noise on optimal neural computation.

Indexed as

choicematching lawneuronsreinforcement learningreward magnitudevalue

Identifiers

PMID26664702
PMCPMC4654444

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.