Learning to Assist Agents by Observing Them

Antti Keurulainen*, Isak Westerlund, Samuel Kaski, Alexander Ilin

*Tämän työn vastaava kirjoittaja

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

Abstrakti

The ability of an AI agent to assist other agents, such as humans, is an important and challenging goal, which requires the assisting agent to reason about the behavior and infer the goals of the assisted agent. Training such an ability by using reinforcement learning usually requires large amounts of online training, which is difficult and costly. On the other hand, offline data about the behavior of the assisted agent might be available, but is non-trivial to take advantage of by methods such as offline reinforcement learning. We introduce methods where the capability to create a representation of the behavior is first pre-trained with offline data, after which only a small amount of interaction data is needed to learn an assisting policy. We test the setting in a gridworld where the helper agent has the capability to manipulate the environment of the assisted artificial agents, and introduce three different scenarios where the assistance considerably improves the performance of the assisted agents.

AlkuperäiskieliEnglanti
OtsikkoArtificial Neural Networks and Machine Learning – ICANN 2021 - 30th International Conference on Artificial Neural Networks, Proceedings
ToimittajatIgor Farkaš, Paolo Masulli, Sebastian Otte, Stefan Wermter
Sivut519-530
Sivumäärä12
DOI - pysyväislinkit
TilaJulkaistu - 2021
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaInternational Conference on Artificial Neural Networks - Virtual, Online
Kesto: 14 syyskuuta 202117 syyskuuta 2021
Konferenssinumero: 30

Julkaisusarja

NimiLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Vuosikerta12894 LNCS
ISSN (painettu)0302-9743
ISSN (elektroninen)1611-3349

Conference

ConferenceInternational Conference on Artificial Neural Networks
LyhennettäICANN
KaupunkiVirtual, Online
Ajanjakso14/09/202117/09/2021

Sormenjälki

Sukella tutkimusaiheisiin 'Learning to Assist Agents by Observing Them'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä