Evidence map›Paper›PMID 36080961›Full record

ArticleSensors (Basel, Switzerland)2022

Visual Pretraining via Contrastive Predictive Model for Pixel-Based Reinforcement Learning.

Tung M Luu, Thang Vu, Thanh Nguyen, Chang D Yoo

Abstract read
In one paragraph

Article in Sensors (Basel, Switzerland), 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Tung M LuuSchool of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea.ORCID 0000-0001-9488-7463
Thang VuSchool of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea.
Thanh NguyenSchool of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea.ORCID 0000-0003-3533-4054
Chang D YooSchool of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea.ORCID 0000-0002-0756-7179

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

In an attempt to overcome the limitations of reward-driven representation learning in vision-based reinforcement learning (RL), an unsupervised learning framework referred to as the visual pretraining via contrastive predictive model (VPCPM) is proposed to learn the representations detached from the policy learning. Our method enables the convolutional encoder to perceive the underlying dynamics through a pair of forward and inverse models under the supervision of the contrastive loss, thus resulting in better representations. In experiments with a diverse set of vision control tasks, by initializing the encoders with VPCPM, the performance of state-of-the-art vision-based RL algorithms is significantly boosted, with 44% and 10% improvement for RAD and DrQ at 100 steps, respectively. In comparison to the prior unsupervised methods, the performance of VPCPM matches or outperforms all the baselines. We further demonstrate that the learned representations successfully generalize to the new tasks that share a similar observation and action space.

Indexed as

AlgorithmsReinforcement, PsychologyRewarddeep reinforcement learningrepresentation learningsample efficiencyvision-based deep reinforcement learning

Identifiers

PMID36080961
PMCPMC9460564

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.