Evidence map›Paper›PMID 34336935›Full record

ArticleFrontiers in robotics and AI2021

You Were Always on My Mind: Introducing Chef's Hat and COPPER for Personalized Reinforcement Learning.

Pablo Barros, Anne C Bloem, Inge M Hootsmans, Lena M Opheij, Romain H A Toebosch, Emilia Barakova, Alessandra Sciutti

Abstract read
In one paragraph

Article in Frontiers in robotics and AI, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Pablo BarrosCognitive Architecture for Collaborative Technologies (CONTACT) Unit Istituto Italiano di Tecnologia, Genova, Italy.
Anne C BloemDepartment of Industrial Design, University of Technology Eindhoven, Eindhoven, Netherlands.
Inge M HootsmansDepartment of Industrial Design, University of Technology Eindhoven, Eindhoven, Netherlands.
Lena M OpheijDepartment of Industrial Design, University of Technology Eindhoven, Eindhoven, Netherlands.
Romain H A ToeboschDepartment of Industrial Design, University of Technology Eindhoven, Eindhoven, Netherlands.
Emilia BarakovaDepartment of Industrial Design, University of Technology Eindhoven, Eindhoven, Netherlands.
Alessandra SciuttiCognitive Architecture for Collaborative Technologies (CONTACT) Unit Istituto Italiano di Tecnologia, Genova, Italy.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Reinforcement learning simulation environments pose an important experimental test bed and facilitate data collection for developing AI-based robot applications. Most of them, however, focus on single-agent tasks, which limits their application to the development of social agents. This study proposes the Chef's Hat simulation environment, which implements a multi-agent competitive card game that is a complete reproduction of the homonymous board game, designed to provoke competitive strategies in humans and emotional responses. The game was shown to be ideal for developing personalized reinforcement learning, in an online learning closed-loop scenario, as its state representation is extremely dynamic and directly related to each of the opponent's actions. To adapt current reinforcement learning agents to this scenario, we also developed the COmPetitive Prioritized Experience Replay (COPPER) algorithm. With the help of COPPER and the Chef's Hat simulation environment, we evaluated the following: (1) 12 experimental learning agents, trained

Indexed as

continual reinforcement learninghuman modeling through online gamesopponent-aware competitive learningreinforcement learningsimulation environment for reinforcement learning

Identifiers

PMID34336935
PMCPMC8323774

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.