Abstract
This paper contributes a novel sensing approach to support on- and above-skin finger input for interaction on the move. WatchSense uses a depth sensor embedded in a wearable device to expand the input space to neighboring areas of skin and the space above it. Our approach addresses challenging camera-based tracking conditions, such as oblique viewing angles and occlusions. It can accurately detect fingertips, their locations, and whether they are touching the skin or hovering above it. It extends previous work that supported either mid-air or multitouch input by simultaneously supporting both. We demonstrate feasibility with a compact, wearable prototype attached to a user’s forearm (simulating an integrated depth sensor). Our prototype—which runs in real-time on consumer mobile devices—enables a 3D input space on the back of the hand. We evaluated the accuracy and robustness of the approach in a user study. We also show how WatchSense increases the expressiveness of input by interweaving mid-air and multitouch for several interactive applications.
Original language | English |
---|---|
Title of host publication | Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems |
Publisher | ACM SIGCHI |
Pages | 3891-3902 |
ISBN (Print) | 978-1-4503-4655-9 |
DOIs | |
Publication status | Published - 2017 |
MoE publication type | A4 Conference publication |
Event | ACM SIGCHI Annual Conference on Human Factors in Computing Systems - Colorado Convention Center, Denver, United States Duration: 6 May 2017 → 11 May 2017 Conference number: 35 https://chi2017.acm.org/ |
Conference
Conference | ACM SIGCHI Annual Conference on Human Factors in Computing Systems |
---|---|
Abbreviated title | ACM CHI |
Country/Territory | United States |
City | Denver |
Period | 06/05/2017 → 11/05/2017 |
Internet address |
Keywords
- Depth sensor
- Skin interaction
- Smartwatch
- Finger tracking