Evidence map›Paper›PMID 34772943›Full record

ArticleNature communications2021

Entropy-based metrics for predicting choice behavior based on local response to reward.

Ethan Trepka, Mehran Spitmaan, Bilal A Bari, Vincent D Costa, Jeremiah Y Cohen, Alireza Soltani

Open access · goldAbstract read
In one paragraph

Article in Nature communications, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed
5.2field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 27 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. The role of rat prelimbic cortex in decision making.bioRxiv : the preprint server for biology · 2024
    Article
  12. Article
  13. Article
  14. Article
  15. Undermatching Is a Consequence of Policy Compression.The Journal of neuroscience : the official journal of the Society for Neuroscience · 2023
    Article
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 3 institutions in 1 country.

Ethan Trepka *Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
Mehran Spitmaan *Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.ORCID http://orcid.org/0000-0003-4948-0677
Bilal A BariThe Solomon H. Snyder Department of Neuroscience, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.
Vincent D CostaDepartment of Behavioral Neuroscience, Oregon Health and Science University, Portland, OR, USA.ORCID http://orcid.org/0000-0002-5412-8945
Jeremiah Y CohenThe Solomon H. Snyder Department of Neuroscience, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.ORCID http://orcid.org/0000-0002-4768-7124
Alireza SoltaniDepartment of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA. alireza.soltani@dartmouth.edu.ORCID http://orcid.org/0000-0003-4386-8486
Dartmouth College · USJohns Hopkins University · USOregon Health & Science University · US

Funding

CRCNS Research Proposal: Cortico-amygdalar substrates of adaptive learningR01DA047870 · NIDA · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI Alicia Izquierdo, Alireza Soltani · 2018 to 2026
$4.1M
Norepinephrine modulation of neocortex during flexible behaviorR01NS104834 · NINDS · JOHNS HOPKINS UNIVERSITY · PI COHEN, JEREMIAH YAACOV, O'CONNOR, DANIEL HANS · 2018 to 2022
$4.1M
Neurocomputational mechanisms of explore-exploit decision making in prefrontal and motivational neural circuitsR01MH125824 · NIMH · OREGON HEALTH & SCIENCE UNIVERSITY · PI COSTA, VINCENT D · 2021 to 2025
$3.2M
NIDA NIH HHS R01 DA047870NIMH NIH HHS R01 MH125824NINDS NIH HHS R01 NS104834
6 · The paper itself

Abstract

For decades, behavioral scientists have used the matching law to quantify how animals distribute their choices between multiple options in response to reinforcement they receive. More recently, many reinforcement learning (RL) models have been developed to explain choice by integrating reward feedback over time. Despite reasonable success of RL models in capturing choice on a trial-by-trial basis, these models cannot capture variability in matching behavior. To address this, we developed metrics based on information theory and applied them to choice data from dynamic learning tasks in mice and monkeys. We found that a single entropy-based metric can explain 50% and 41% of variance in matching in mice and monkeys, respectively. We then used limitations of existing RL models in capturing entropy-based metrics to construct more accurate models of choice. Together, our entropy-based metrics provide a model-free tool to predict adaptive choice behavior and reveal underlying neural mechanisms.

Indexed as

EntropyRewardAnimalsBehavior, AnimalChoice BehaviorDecision MakingHaplorhiniLearningMacaca mulattaMaleMiceMice, Inbred C57BLModels, NeurologicalReinforcement, Psychology

Identifiers

PMID34772943
PMCPMC8590026
OpenAlexW3213352182

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.