Touchscreen typing as optimal supervisory control

Jussi P.P. Jokinen, Aditya Acharya, Mohammad Uzair, Xinhui Jiang, Antti Oulasvirta

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

6 Lataukset (Pure)


Traditionally, touchscreen typing has been studied in terms of motor performance. However, recent research has exposed a decisive role of visual attention being shared between the keyboard and the text area. Strategies for this are known to adapt to the task, design, and user. In this paper, we propose a unifying account of touchscreen typing, regarding it as optimal supervisory control. Under this theory, rules for controlling visuo-motor resources are learned via exploration in pursuit of maximal typing performance. The paper outlines the control problem and explains how visual and motor limitations afect it. We then present a model, implemented via reinforcement learning, that simulates co-ordination of eye and fnger movements. Comparison with human data affrms that the model creates realistic fnger-and eye-movement patterns and shows human-like adaptation. We demonstrate the model's utility for interface development in evaluating touchscreen keyboard designs.

OtsikkoCHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
ISBN (elektroninen)9781450380966
DOI - pysyväislinkit
TilaJulkaistu - 6 toukokuuta 2021
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaACM SIGCHI Annual Conference on Human Factors in Computing Systems - Virtual, Online
Kesto: 8 toukokuuta 202113 toukokuuta 2021


ConferenceACM SIGCHI Annual Conference on Human Factors in Computing Systems
LyhennettäACM CHI
KaupunkiVirtual, Online


Sukella tutkimusaiheisiin 'Touchscreen typing as optimal supervisory control'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä