Evidence map›Paper›PMID 24402920›Full record

ArticleJournal of the Royal Society, Interface2014

The evolution of continuous learning of the structure of the environment.

Oren Kolodny, Shimon Edelman, Arnon Lotem

Abstract read
In one paragraph

Article in Journal of the Royal Society, Interface, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Evolution of diverse (and advanced) cognitive abilities through adaptive fine-tuning of learning and chunking mechanisms.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2025
    Article
  2. Article
  3. Article
  4. Article
  5. The evolution of cognitive mechanisms in response to cultural innovations.Proceedings of the National Academy of Sciences of the United States of America · 2017
    Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Oren KolodnyFaculty of Life Sciences, Department of Zoology, Tel-Aviv University, , Tel-Aviv 69978, Israel.
Shimon Edelman
Arnon Lotem

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Continuous, 'always on', learning of structure from a stream of data is studied mainly in the fields of machine learning or language acquisition, but its evolutionary roots may go back to the first organisms that were internally motivated to learn and represent their environment. Here, we study under what conditions such continuous learning (CL) may be more adaptive than simple reinforcement learning and examine how it could have evolved from the same basic associative elements. We use agent-based computer simulations to compare three learning strategies: simple reinforcement learning; reinforcement learning with chaining (RL-chain) and CL that applies the same associative mechanisms used by the other strategies, but also seeks statistical regularities in the relations among all items in the environment, regardless of the initial association with food. We show that a sufficiently structured environment favours the evolution of both RL-chain and CL and that CL outperforms the other strategies when food is relatively rare and the time for learning is limited. This advantage of internally motivated CL stems from its ability to capture statistical patterns in the environment even before they are associated with food, at which point they immediately become useful for planning.

Indexed as

Biological EvolutionEnvironmentModels, BiologicalAdaptation, BiologicalCognitionComputer SimulationDecision MakingLearningSpecies Specificitydecision-makingevolution of cognitionforaging theoryrepresentationstatistical learning

Identifiers

PMID24402920
PMCPMC3899879

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.