Evidence map›Paper›PMID 38365840›Full record

ArticleeNeuro2024

The Neural Correlates of Individual Differences in Reinforcement Learning during Pain Avoidance and Reward Seeking.

Thang M Le, Takeyuki Oba, Luke Couch, Lauren McInerney, Chiang-Shan R Li

Open access · goldAbstract read
In one paragraph

Article in eNeuro, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
2.7field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 8 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Reinforcement feedback impairs locomotor adaptation and retention.Frontiers in behavioral neuroscience · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 2 institutions in 2 countries.

Thang M LeDepartment of Psychiatry, Yale University School of Medicine, New Haven, Connecticut 06519 thang.le@yale.edu.ORCID https://orcid.org/0000-0002-4196-8646
Takeyuki ObaHuman Informatics and Interaction Research Institute, the National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba 305-8560, Japan.
Luke CouchDepartment of Psychiatry, Yale University School of Medicine, New Haven, Connecticut 06519.
Lauren McInerneyDepartment of Psychiatry, Yale University School of Medicine, New Haven, Connecticut 06519.
Chiang-Shan R LiDepartment of Psychiatry, Yale University School of Medicine, New Haven, Connecticut 06519.ORCID https://orcid.org/0000-0002-9393-1212
Yale University · USNational Institute of Advanced Industrial Science and Technology · JP

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Noradrenergic mechanisms of alcohol's impact on the development of MCI and early stage ADR01AG072893 · NIA · YALE UNIVERSITY · PI LI, CHIANG-SHAN RAY · 2020 to 2024
$1.8M
Avoidance learning and pain circuit dysfunction in alcohol use disordersR00AA029716 · NIAAA · YALE UNIVERSITY · PI Thang Manh Le · 2024 to 2026
$746k
Avoidance learning and pain circuit dysfunction in alcohol use disordersK99AA029716 · NIAAA · YALE UNIVERSITY · PI LE, THANG MANH · 2022 to 2023
$262k
NCATS NIH HHS UL1 TR001863NIAAA NIH HHS K99 AA029716NIAAA NIH HHS R00 AA029716NIA NIH HHS R01 AG072893
6 · The paper itself

Abstract

Organisms learn to gain reward and avoid punishment through action-outcome associations. Reinforcement learning (RL) offers a critical framework to understand individual differences in this associative learning by assessing learning rate, action bias, pavlovian factor (i.e., the extent to which action values are influenced by stimulus values), and subjective impact of outcomes (i.e., motivation to seek reward and avoid punishment). Nevertheless, how these individual-level metrics are represented in the brain remains unclear. The current study leveraged fMRI in healthy humans and a probabilistic learning go/no-go task to characterize the neural correlates involved in learning to seek reward and avoid pain. Behaviorally, participants showed a higher learning rate during pain avoidance relative to reward seeking. Additionally, the subjective impact of outcomes was greater for reward trials and associated with lower response randomness. Our imaging findings showed that individual differences in learning rate and performance accuracy during avoidance learning were positively associated with activities of the dorsal anterior cingulate cortex, midcingulate cortex, and postcentral gyrus. In contrast, the pavlovian factor was represented in the precentral gyrus and superior frontal gyrus (SFG) during pain avoidance and reward seeking, respectively. Individual variation of the subjective impact of outcomes was positively predicted by activation of the left posterior cingulate cortex. Finally, action bias was represented by the supplementary motor area (SMA) and pre-SMA whereas the SFG played a role in restraining this action tendency. Together, these findings highlight for the first time the neural substrates of individual differences in the computational processes during RL.

Indexed as

IndividualityLearningAvoidance LearningHumansMagnetic Resonance ImagingPainReinforcement, PsychologyRewardanterior cingulate cortexavoidance learningfMRIpainreinforcement learningreward

Identifiers

PMID38365840
PMCPMC10901196
OpenAlexW4391885705

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.