Evidence map›Paper›PMID 23565092›Full record

ArticleFrontiers in neurorobotics2013

Rare neural correlations implement robotic conditioning with delayed rewards and disturbances.

Andrea Soltoggio, Andre Lemme, Felix Reinhart, Jochen J Steil

Abstract read
In one paragraph

Article in Frontiers in neurorobotics, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. RM-SORN: a reward-modulated self-organizing recurrent neural network.Frontiers in computational neuroscience · 2015
    Article
  6. Article
  7. Article
  8. Value and reward based learning in neurorobots.Frontiers in neurorobotics · 2013
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Andrea SoltoggioFaculty of Technology, Research Institute for Cognition and Robotics (CoR-Lab), Bielefeld University Bielefeld, Germany.
Andre Lemme
Felix Reinhart
Jochen J Steil

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Neural conditioning associates cues and actions with following rewards. The environments in which robots operate, however, are pervaded by a variety of disturbing stimuli and uncertain timing. In particular, variable reward delays make it difficult to reconstruct which previous actions are responsible for following rewards. Such an uncertainty is handled by biological neural networks, but represents a challenge for computational models, suggesting the lack of a satisfactory theory for robotic neural conditioning. The present study demonstrates the use of rare neural correlations in making correct associations between rewards and previous cues or actions. Rare correlations are functional in selecting sparse synapses to be eligible for later weight updates if a reward occurs. The repetition of this process singles out the associating and reward-triggering pathways, and thereby copes with distal rewards. The neural network displays macro-level classical and operant conditioning, which is demonstrated in an interactive real-life human-robot interaction. The proposed mechanism models realistic conditioning in humans and animals and implements similar behaviors in neuro-robotic platforms.

Indexed as

classical conditioningdistal rewardinstrumental conditioningneuromodulationrobotics

Identifiers

PMID23565092
PMCPMC3613617

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.