WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor

Srinath Sridhar, Anders Markussen, Antti Oulasvirta, Christian Theobalt, Sebastian Boring

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

65 Citations (Scopus)
125 Downloads (Pure)

Abstract

This paper contributes a novel sensing approach to support on- and above-skin finger input for interaction on the move. WatchSense uses a depth sensor embedded in a wearable device to expand the input space to neighboring areas of skin and the space above it. Our approach addresses challenging camera-based tracking conditions, such as oblique viewing angles and occlusions. It can accurately detect fingertips, their locations, and whether they are touching the skin or hovering above it. It extends previous work that supported either mid-air or multitouch input by simultaneously supporting both. We demonstrate feasibility with a compact, wearable prototype attached to a user’s forearm (simulating an integrated depth sensor). Our prototype—which runs in real-time on consumer mobile devices—enables a 3D input space on the back of the hand. We evaluated the accuracy and robustness of the approach in a user study. We also show how WatchSense increases the expressiveness of input by interweaving mid-air and multitouch for several interactive applications.
Original languageEnglish
Title of host publicationProceedings of the 2017 CHI Conference on Human Factors in Computing Systems
PublisherACM SIGCHI
Pages3891-3902
ISBN (Print)978-1-4503-4655-9
DOIs
Publication statusPublished - 2017
MoE publication typeA4 Conference publication
EventACM SIGCHI Annual Conference on Human Factors in Computing Systems - Colorado Convention Center, Denver, United States
Duration: 6 May 201711 May 2017
Conference number: 35
https://chi2017.acm.org/

Conference

ConferenceACM SIGCHI Annual Conference on Human Factors in Computing Systems
Abbreviated titleACM CHI
Country/TerritoryUnited States
CityDenver
Period06/05/201711/05/2017
Internet address

Keywords

  • Depth sensor
  • Skin interaction
  • Smartwatch
  • Finger tracking

Fingerprint

Dive into the research topics of 'WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor'. Together they form a unique fingerprint.

Cite this