CRTypist: Simulating Touchscreen Typing Behavior via Computational Rationality

Danqing Shi, Yujun Zhu, Jussi P.P. Jokinen, Aditya Acharya, Aini Putkonen, Shumin Zhai, Antti Oulasvirta

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

18 Lataukset (Pure)

Abstrakti

Touchscreen typing requires coordinating the fingers and visual attention for button-pressing, proofreading, and error correction. Computational models need to account for the associated fast pace, coordination issues, and closed-loop nature of this control problem, which is further complicated by the immense variety of keyboards and users. The paper introduces CRTypist, which generates human-like typing behavior. Its key feature is a reformulation of the supervisory control problem, with the visual attention and motor system being controlled with reference to a working memory representation tracking the text typed thus far. Movement policy is assumed to asymptotically approach optimal performance in line with cognitive and design-related bounds. This flexible model works directly from pixels, without requiring hand-crafted feature engineering for keyboards. It aligns with human data in terms of movements and performance, covers individual differences, and can generalize to diverse keyboard designs. Though limited to skilled typists, the model generates useful estimates of the typing performance achievable under various conditions.
AlkuperäiskieliEnglanti
OtsikkoCHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
ToimittajatFlorian Floyd Mueller, Penny Kyburz, Julie R. Williamson, Corina Sas, Max L. Wilson, Phoebe Toups Dugas, Irina Shklovski
KustantajaACM
Sivumäärä17
ISBN (elektroninen)979-8-4007-0330-0
DOI - pysyväislinkit
TilaJulkaistu - 11 toukok. 2024
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaACM SIGCHI Annual Conference on Human Factors in Computing Systems - Honolulu, USA, Honolulu, Yhdysvallat
Kesto: 11 toukok. 202416 toukok. 2024
https://chi2024.acm.org/

Conference

ConferenceACM SIGCHI Annual Conference on Human Factors in Computing Systems
LyhennettäACM CHI
Maa/AlueYhdysvallat
KaupunkiHonolulu
Ajanjakso11/05/202416/05/2024
www-osoite

Sormenjälki

Sukella tutkimusaiheisiin 'CRTypist: Simulating Touchscreen Typing Behavior via Computational Rationality'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä