How We Type: Eye and Finger Movement Strategies in Mobile Typing

Xinhui Jiang, Yang Li, Jussi P.P. Jokinen, Viet Ba Hirvola, Antti Oulasvirta, Xiangshi Ren

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

7 Downloads (Pure)

Abstract

Relatively little is known about eye and finger movement in typing with mobile devices. Most prior studies of mobile typing rely on log data, while data on finger and eye movements in typing come from studies with physical keyboards. This paper presents new findings from a transcription task with mobile touchscreen devices. Movement strategies were found to emerge in response to sharing of visual attention: attention is needed for guiding finger movements and detecting typing errors. In contrast to typing on physical keyboards, visual attention is kept mostly on the virtual keyboard, and glances at the text display are associated with performance. When typing with two fingers, although users make more errors, they manage to detect and correct them more quickly. This explains part of the known superiority of two-thumb typing over one-finger typing. We release the extensive dataset on everyday typing on smartphones.

Original languageEnglish
Title of host publicationCHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
PublisherACM
ISBN (Electronic)9781450367080
DOIs
Publication statusPublished - 21 Apr 2020
MoE publication typeA4 Article in a conference publication
EventACM SIGCHI Annual Conference on Human Factors in Computing Systems -
Duration: 26 Apr 202030 Apr 2020

Conference

ConferenceACM SIGCHI Annual Conference on Human Factors in Computing Systems
Abbreviated titleACM CHI
Period26/04/202030/04/2020

Keywords

  • eye movement
  • eye-hand coordination
  • finger movement
  • mobile device
  • text input

Fingerprint Dive into the research topics of 'How We Type: Eye and Finger Movement Strategies in Mobile Typing'. Together they form a unique fingerprint.

Cite this