Teaching to Learn: Sequential Teaching of Learners with Internal States

Mustafa Mert Çelikok, Pierre Alexandre Murena, Samuel Kaski

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

Abstract

In sequential machine teaching, a teacher's objective is to provide the optimal sequence of inputs to sequential learners in order to guide them towards the best model. However, this teaching objective considers a restricted class of learners with fixed inductive biases. In this paper, we extend the machine teaching framework to learners that can improve their inductive biases, represented as latent internal states, in order to generalize to new datasets. We introduce a novel framework in which learners' inductive biases may change with the teaching interaction, which affects the learning performance in future tasks. In order to teach such learners, we propose a multi-objective control approach that takes the future performance of the learner after teaching into account. This framework provides tools for modelling learners with internal states, humans and meta-learning algorithms alike. Furthermore, we distinguish manipulative teaching, which can be done by effectively hiding data and also used for indoctrination, from teaching to learn which aims to help the learner become better at learning from new datasets in the absence of a teacher. Our empirical results demonstrate that our framework is able to reduce the number of required tasks for online meta-learning, and increases independent learning performance of simulated human users in future tasks.

Original languageEnglish
Title of host publicationAAAI-23 Technical Tracks 5
EditorsBrian Williams, Yiling Chen, Jennifer Neville
PublisherAAAI Press
Pages5939-5947
Number of pages9
ISBN (Electronic)978-1-57735-880-0
DOIs
Publication statusPublished - 27 Jun 2023
MoE publication typeA4 Conference publication
EventAAAI Conference on Artificial Intelligence - Walter E. Washington Convention Center, Washington, United States
Duration: 7 Feb 202314 Feb 2023
Conference number: 37
https://aaai-23.aaai.org/

Publication series

NameProceedings of the AAAI Conference on Artificial Intelligence
Number5
Volume37
ISSN (Electronic)2374-3468

Conference

ConferenceAAAI Conference on Artificial Intelligence
Abbreviated titleAAAI
Country/TerritoryUnited States
CityWashington
Period07/02/202314/02/2023
Internet address

Fingerprint

Dive into the research topics of 'Teaching to Learn: Sequential Teaching of Learners with Internal States'. Together they form a unique fingerprint.

Cite this