Evidence map›Paper›PMID 33304260›Full record

ArticleFrontiers in computational neuroscience2020

Learning Generative State Space Models for Active Inference.

Ozan Çatal, Samuel Wauthier, Cedric De Boom, Tim Verbelen, Bart Dhoedt

Open access · goldAbstract read
In one paragraph

Article in Frontiers in computational neuroscience, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
3.0field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 37 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. A neural active inference model of perceptual-motor learning.Frontiers in computational neuroscience · 2023
    Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Ozan ÇatalIDLab, Department of Information Technology, Ghent University - imec, Ghent, Belgium.
Samuel WauthierIDLab, Department of Information Technology, Ghent University - imec, Ghent, Belgium.
Cedric De BoomIDLab, Department of Information Technology, Ghent University - imec, Ghent, Belgium.
Tim VerbelenIDLab, Department of Information Technology, Ghent University - imec, Ghent, Belgium.
Bart DhoedtIDLab, Department of Information Technology, Ghent University - imec, Ghent, Belgium.
Ghent University · BE

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

In this paper we investigate the active inference framework as a means to enable autonomous behavior in artificial agents. Active inference is a theoretical framework underpinning the way organisms act and observe in the real world. In active inference, agents act in order to minimize their so called free energy, or prediction error. Besides being biologically plausible, active inference has been shown to solve hard exploration problems in various simulated environments. However, these simulations typically require handcrafting a generative model for the agent. Therefore we propose to use recent advances in deep artificial neural networks to learn generative state space models from scratch, using only observation-action sequences. This way we are able to scale active inference to new and challenging problem domains, whilst still building on the theoretical backing of the free energy principle. We validate our approach on the mountain car problem to illustrate that our learnt models can indeed trade-off instrumental value and ambiguity. Furthermore, we show that generative models can also be learnt using high-dimensional pixel observations, both in the OpenAI Gym car racing environment and a real-world robotic navigation task. Finally we show that active inference based policies are an order of magnitude more sample efficient than Deep Q Networks on RL tasks.

Indexed as

active inferencedeep learningfree energygenerative modelingrobotics

Identifiers

PMID33304260
PMCPMC7701292
OpenAlexW3098317736

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.