Evidence map›Paper›PMID 32251444›Full record

ArticlePLoS computational biology2020

Discovery of hierarchical representations for efficient planning.

Momchil S Tomov, Samyukta Yagati, Agni Kumar, Wanqian Yang, Samuel J Gershman

Abstract read
In one paragraph

Article in PLoS computational biology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 41 papers.

0numbers the graph read from it
0cells of the map it votes in
41citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

41 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Learning to select computations in recurrent neural circuits.bioRxiv : the preprint server for biology · 2026
    Article
  5. Prefrontal Mechanisms of Rule Learning.bioRxiv : the preprint server for biology · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Cognitive maps for hierarchical spaces in the human brain.Cerebral cortex (New York, N.Y. : 1991) · 2025
    Article
  10. Adaptive planning depth in human problem-solving.Royal Society open science · 2025
    Article
  11. Review
  12. Article
  13. Expert navigators deploy rational complexity-based decision precaching for large-scale real-world planning.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  14. Article
  15. Cognitive Control.Annual review of psychology · 2025
    Review
  16. Article
  17. Article
  18. Approximate planning in spatial search.PLoS computational biology · 2024
    Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Momchil S TomovProgram in Neuroscience, Harvard Medical School, Boston, Massachusetts, United States of America.ORCID 0000-0002-0949-302X
Samyukta YagatiDepartment of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
Agni KumarDepartment of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
Wanqian YangSchool of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts, United States of America.ORCID 0000-0002-6372-3607
Samuel J GershmanDepartment of Psychology and Center for Brain Science, Harvard University, Cambridge, Massachusetts, United States of America.ORCID 0000-0002-6546-3298

Funding

CRCNS: Representational foundations of adaptive behavior in natural and artificial R01MH109177 · NIMH · PRINCETON UNIVERSITY · PI DAW, NATHANIEL DOUGLASS · 2015 to 2017
$1.2M
NIMH NIH HHS R01 MH109177
6 · The paper itself

Abstract

We propose that humans spontaneously organize environments into clusters of states that support hierarchical planning, enabling them to tackle challenging problems by breaking them down into sub-problems at various levels of abstraction. People constantly rely on such hierarchical presentations to accomplish tasks big and small-from planning one's day, to organizing a wedding, to getting a PhD-often succeeding on the very first attempt. We formalize a Bayesian model of hierarchy discovery that explains how humans discover such useful abstractions. Building on principles developed in structure learning and robotics, the model predicts that hierarchy discovery should be sensitive to the topological structure, reward distribution, and distribution of tasks in the environment. In five simulations, we show that the model accounts for previously reported effects of environment structure on planning behavior, such as detection of bottleneck states and transitions. We then test the novel predictions of the model in eight behavioral experiments, demonstrating how the distribution of tasks and rewards can influence planning behavior via the discovered hierarchy, sometimes facilitating and sometimes hindering performance. We find evidence that the hierarchy discovery process unfolds incrementally across trials. Finally, we propose how hierarchy discovery and hierarchical planning might be implemented in the brain. Together, these findings present an important advance in our understanding of how the brain might use Bayesian inference to discover and exploit the hidden hierarchical structure of the environment.

Indexed as

Bayes TheoremAlgorithmsBrainComputer SimulationFemaleHumansLearningMaleMarkov ChainsModels, NeurologicalMonte Carlo MethodRewardVideo Games

Identifiers

PMID32251444
PMCPMC7162548

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.