WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Standard

WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor. / Sridhar, Srinath; Markussen, Anders; Oulasvirta, Antti; Theobalt, Christian; Boring, Sebastian.

Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM SIGCHI, 2017. p. 3891-3902.

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Harvard

Sridhar, S, Markussen, A, Oulasvirta, A, Theobalt, C & Boring, S 2017, WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor. in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM SIGCHI, pp. 3891-3902, ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Denver, United States, 06/05/2017. https://doi.org/10.1145/3025453.3026005

APA

Sridhar, S., Markussen, A., Oulasvirta, A., Theobalt, C., & Boring, S. (2017). WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 3891-3902). ACM SIGCHI. https://doi.org/10.1145/3025453.3026005

Vancouver

Sridhar S, Markussen A, Oulasvirta A, Theobalt C, Boring S. WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM SIGCHI. 2017. p. 3891-3902 https://doi.org/10.1145/3025453.3026005

Author

Sridhar, Srinath ; Markussen, Anders ; Oulasvirta, Antti ; Theobalt, Christian ; Boring, Sebastian. / WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM SIGCHI, 2017. pp. 3891-3902

Bibtex - Download

@inproceedings{843209d5de104bf6a5023667160fbbea,
title = "WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor",
abstract = "This paper contributes a novel sensing approach to support on- and above-skin finger input for interaction on the move. WatchSense uses a depth sensor embedded in a wearable device to expand the input space to neighboring areas of skin and the space above it. Our approach addresses challenging camera-based tracking conditions, such as oblique viewing angles and occlusions. It can accurately detect fingertips, their locations, and whether they are touching the skin or hovering above it. It extends previous work that supported either mid-air or multitouch input by simultaneously supporting both. We demonstrate feasibility with a compact, wearable prototype attached to a user’s forearm (simulating an integrated depth sensor). Our prototype—which runs in real-time on consumer mobile devices—enables a 3D input space on the back of the hand. We evaluated the accuracy and robustness of the approach in a user study. We also show how WatchSense increases the expressiveness of input by interweaving mid-air and multitouch for several interactive applications.",
keywords = "Depth sensor, Skin interaction, Smartwatch, Finger tracking",
author = "Srinath Sridhar and Anders Markussen and Antti Oulasvirta and Christian Theobalt and Sebastian Boring",
note = "| openaire: EC/H2020/637991/EU//COMPUTED | openaire: EC/FP7/335545/EU//CapReal | openaire: EC/H2020/648785/EU//BODY-UI",
year = "2017",
doi = "10.1145/3025453.3026005",
language = "English",
isbn = "978-1-4503-4655-9",
pages = "3891--3902",
booktitle = "Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems",
publisher = "ACM SIGCHI",

}

RIS - Download

TY - GEN

T1 - WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor

AU - Sridhar, Srinath

AU - Markussen, Anders

AU - Oulasvirta, Antti

AU - Theobalt, Christian

AU - Boring, Sebastian

N1 - | openaire: EC/H2020/637991/EU//COMPUTED | openaire: EC/FP7/335545/EU//CapReal | openaire: EC/H2020/648785/EU//BODY-UI

PY - 2017

Y1 - 2017

N2 - This paper contributes a novel sensing approach to support on- and above-skin finger input for interaction on the move. WatchSense uses a depth sensor embedded in a wearable device to expand the input space to neighboring areas of skin and the space above it. Our approach addresses challenging camera-based tracking conditions, such as oblique viewing angles and occlusions. It can accurately detect fingertips, their locations, and whether they are touching the skin or hovering above it. It extends previous work that supported either mid-air or multitouch input by simultaneously supporting both. We demonstrate feasibility with a compact, wearable prototype attached to a user’s forearm (simulating an integrated depth sensor). Our prototype—which runs in real-time on consumer mobile devices—enables a 3D input space on the back of the hand. We evaluated the accuracy and robustness of the approach in a user study. We also show how WatchSense increases the expressiveness of input by interweaving mid-air and multitouch for several interactive applications.

AB - This paper contributes a novel sensing approach to support on- and above-skin finger input for interaction on the move. WatchSense uses a depth sensor embedded in a wearable device to expand the input space to neighboring areas of skin and the space above it. Our approach addresses challenging camera-based tracking conditions, such as oblique viewing angles and occlusions. It can accurately detect fingertips, their locations, and whether they are touching the skin or hovering above it. It extends previous work that supported either mid-air or multitouch input by simultaneously supporting both. We demonstrate feasibility with a compact, wearable prototype attached to a user’s forearm (simulating an integrated depth sensor). Our prototype—which runs in real-time on consumer mobile devices—enables a 3D input space on the back of the hand. We evaluated the accuracy and robustness of the approach in a user study. We also show how WatchSense increases the expressiveness of input by interweaving mid-air and multitouch for several interactive applications.

KW - Depth sensor

KW - Skin interaction

KW - Smartwatch

KW - Finger tracking

U2 - 10.1145/3025453.3026005

DO - 10.1145/3025453.3026005

M3 - Conference contribution

SN - 978-1-4503-4655-9

SP - 3891

EP - 3902

BT - Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

PB - ACM SIGCHI

ER -

ID: 17425933