Evidence map›Paper›PMID 33444700›Full record

ReviewNeuroscience and biobehavioral reviews2021

Why and how the brain weights contributions from a mixture of experts.

John P O'Doherty, Sang Wan Lee, Reza Tadayonnejad, Jeff Cockburn, Kyo Iigaya, Caroline J Charpentier

Abstract readReview
In one paragraph

Review in Neuroscience and biobehavioral reviews, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. A neural mechanism for online discovery of latent contexts.bioRxiv : the preprint server for biology · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

John P O'DohertyDivision of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA; Computation and Neural Systems Program, California Institute of Technology, Pasadena, CA, 91125, USA. Electronic address: jdoherty@caltech.edu.
Sang Wan LeeDepartment of Bio and Brain Engineering and Program of Brain and Cognitive Engineering, Korea Advanced Institute of Science Technology (KAIST), Daejeon, 34141, Republic of Korea.
Reza TadayonnejadDivision of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA; Division of Neuromodulation, Semel Institute for Neuroscience and Behavior, University of California, Los Angeles, CA, 90095, USA.
Jeff CockburnDivision of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA.
Kyo IigayaDivision of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA.
Caroline J CharpentierDivision of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, 91125, USA.

Funding

The Neurobiology of Social Decision-Making: Social Inference and ContextP50MH094258 · NIMH · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI ANDERSEN, RICHARD A · 2012 to 2021
$18.6M
Neuronal Substrates of Hemodynamic Signals in the Prefrontal CortexR01MH111425 · NIMH · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI HOWARD, MATTHEW A., O'DOHERTY, JOHN P · 2016 to 2020
$3.6M
Determining the explanatory utility of computational reinforcement-learning theories of goal-directed and habitual control at behavioral and neural levelsR01MH121089 · NIMH · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI O'DOHERTY, JOHN P · 2019 to 2023
$3.5M
Determining the neural substrates of model-based and model-free reinforcement-learning during Pavlovian conditioning (Minority Supplement)R01DA040011 · NIDA · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI O'DOHERTY, JOHN P · 2016 to 2020
$2.6M
Characterizing habitual and goal-directed behavioral control systems in the humanR01DA033077 · NIDA · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI O'DOHERTY, JOHN P · 2011 to 2014
$1.6M
Toward a High Dimensional Computational Description of Variation in Human Decision-Making Across Psychiatric and Non-Psychiatric PopulationsR21MH120805 · NIMH · CALIFORNIA INSTITUTE OF TECHNOLOGY · PI O'DOHERTY, JOHN P · 2019 to 2020
$464k
NIDA NIH HHS R01 DA033077NIDA NIH HHS R01 DA040011NIMH NIH HHS P50 MH094258NIMH NIH HHS R01 MH111425NIMH NIH HHS R01 MH121089NIMH NIH HHS R21 MH120805
6 · The paper itself

Abstract

It has long been suggested that human behavior reflects the contributions of multiple systems that cooperate or compete for behavioral control. Here we propose that the brain acts as a "Mixture of Experts" in which different expert systems propose strategies for action. It will be argued that the brain determines which experts should control behavior at any one moment in time by keeping track of the reliability of the predictions within each system, and by allocating control over behavior in a manner that depends on the relative reliabilities across experts. fMRI and neurostimulation studies suggest a specific contribution of the anterior prefrontal cortex in this process. Further, such a mechanism also takes into consideration the complexity of the expert, favoring simpler over more cognitively complex experts. Results from the study of different expert systems in both experiential and social learning domains hint at the possibility that this reliability-based control mechanism is domain general, exerting control over many different expert systems simultaneously in order to produce sophisticated behavior.

Indexed as

BrainBrain MappingDecision MakingHumansMagnetic Resonance ImagingPrefrontal CortexReproducibility of ResultsBasal gangliaCognitive controlDecision-makingPrefrontal cortexTheoretical neuroscience

Identifiers

PMID33444700
PMCPMC8040830

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.