Gaze-adaptive above and on-surface interaction

Bariş Serim, Khalil Klouche, Giulio Jacucci

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

3 Citations (Scopus)


We explore the combination of above-surface sensing with eye tracking to facilitate concurrent interaction with multiple regions on touch screens. Conventional touch input relies on positional accuracy, thereby requiring tight visual monitoring of one's own motor action. In contrast, above-surface sensing and eye tracking provides information about how user's hands and gaze are distributed across the interface. In these situations we facilitate interaction by 1) showing the visual feedback of the hand hover near user's gaze point and 2) decrease the requisite of positional accuracy by employing gestural information. We contribute input and visual feedback techniques that combine these modalities and demonstrate their use in example applications. A controlled study showed the effectiveness of our techniques for manipulation tasks against conventional touch, while the effectiveness in acquisition tasks depended on the amount of mid-air motion, leading to our conclusion that the techniques can benefit interacting with multiple interface regions. Copyright is held by the owner/author(s).

Original languageEnglish
Title of host publicationDIS 2017 - Proceedings of the 2017 ACM Conference on Designing Interactive Systems
Number of pages13
ISBN (Electronic)9781450349222
Publication statusPublished - 10 Jun 2017
MoE publication typeA4 Article in a conference publication
EventACM Conference on Designing Interactive Systems - Centre for Interaction Design, Edinburgh Napier University, Edinburgh, United Kingdom
Duration: 10 Jun 201714 Jun 2017
Conference number: 12


ConferenceACM Conference on Designing Interactive Systems
Abbreviated titleDIS
Country/TerritoryUnited Kingdom
Internet address


  • Above surface interaction
  • Eye tracking
  • Gaze interaction
  • Multi-touch


Dive into the research topics of 'Gaze-adaptive above and on-surface interaction'. Together they form a unique fingerprint.

Cite this