The missing interface: Micro-gestures on augmented objects

Klen Čopič Pucihar; Wolfgang Huerst; Hirokazu Kato; Christian Sandor; Alexander Plopski; Luis A. Leiva; Matjazč Kljun; Takafumi Taketomi

doi:10.1145/3290607.3312986

Abstract

Augmenting arbitrary physical objects with digital content leads to the missing interface problem, because those objects were never designed to incorporate such digital content and so they lack a user interface. A review of related work reveals that current approaches fail due to limited detection fidelity and spatial resolution. Our proposal, based on Google Soli's radar sensing technology, is designed to detect micro-gestures on objects with sub-millimeter precision. Preliminary results with a custom gesture set show that Soli's core features and traditional machine learning models (Random Forest and Support Vector Machine) do not lead to robust recognition accuracy, and so more advanced techniques should be used instead, possibly incorporating additional sensor features.

Original language	English
DOIs	https://doi.org/10.1145/3290607.3312986
Publication status	Published - 2 May 2019
MoE publication type	Not Eligible
Event	ACM SIGCHI Annual Conference on Human Factors in Computing Systems - Glasgow, United Kingdom Duration: 4 May 2019 → 9 May 2019 https://chi2019.acm.org/

Conference

Conference	ACM SIGCHI Annual Conference on Human Factors in Computing Systems
Abbreviated title	ACM CHI
Country	United Kingdom
City	Glasgow
Period	04/05/2019 → 09/05/2019
Internet address	https://chi2019.acm.org/

Keywords

Augmented Reality
Google Soli
Micro-gesture Recognition
Millimeter-wave Radar

Access to Document

10.1145/3290607.3312986

Link to publication in Scopus

Fingerprint Dive into the research topics of 'The missing interface: Micro-gestures on augmented objects'. Together they form a unique fingerprint.

1 Active

Department of Communications and Networking
Oulasvirta, A., Laine, M., Todi, K., Dayama, N. & Nioche, A.
01/09/2018 → 31/08/2022
Project: Academy of Finland: Other research funding

Cite this

@conference{59e5baf0033c4dbcbbe6cf0df4b2e4be,

title = "The missing interface: Micro-gestures on augmented objects",

abstract = "Augmenting arbitrary physical objects with digital content leads to the missing interface problem, because those objects were never designed to incorporate such digital content and so they lack a user interface. A review of related work reveals that current approaches fail due to limited detection fidelity and spatial resolution. Our proposal, based on Google Soli's radar sensing technology, is designed to detect micro-gestures on objects with sub-millimeter precision. Preliminary results with a custom gesture set show that Soli's core features and traditional machine learning models (Random Forest and Support Vector Machine) do not lead to robust recognition accuracy, and so more advanced techniques should be used instead, possibly incorporating additional sensor features.",

keywords = "Augmented Reality, Google Soli, Micro-gesture Recognition, Millimeter-wave Radar",

author = "Pucihar, {Klen {\v C}opi{\v c}} and Wolfgang Huerst and Hirokazu Kato and Christian Sandor and Alexander Plopski and Leiva, {Luis A.} and Matjaz{\v c} Kljun and Takafumi Taketomi",

year = "2019",

month = may,

day = "2",

doi = "10.1145/3290607.3312986",

language = "English",

note = "ACM SIGCHI Annual Conference on Human Factors in Computing Systems, ACM CHI ; Conference date: 04-05-2019 Through 09-05-2019",

url = "https://chi2019.acm.org/",

}

The missing interface : Micro-gestures on augmented objects. / Pucihar, Klen Čopič; Huerst, Wolfgang; Kato, Hirokazu; Sandor, Christian; Plopski, Alexander; Leiva, Luis A.; Kljun, Matjazč; Taketomi, Takafumi.

2019. Abstract from ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Glasgow, United Kingdom.

Research output: Contribution to conference › Abstract › Scientific › peer-review

TY - CONF

T1 - The missing interface

T2 - ACM SIGCHI Annual Conference on Human Factors in Computing Systems

AU - Pucihar, Klen Čopič

AU - Huerst, Wolfgang

AU - Kato, Hirokazu

AU - Sandor, Christian

AU - Plopski, Alexander

AU - Leiva, Luis A.

AU - Kljun, Matjazč

AU - Taketomi, Takafumi

PY - 2019/5/2

Y1 - 2019/5/2

N2 - Augmenting arbitrary physical objects with digital content leads to the missing interface problem, because those objects were never designed to incorporate such digital content and so they lack a user interface. A review of related work reveals that current approaches fail due to limited detection fidelity and spatial resolution. Our proposal, based on Google Soli's radar sensing technology, is designed to detect micro-gestures on objects with sub-millimeter precision. Preliminary results with a custom gesture set show that Soli's core features and traditional machine learning models (Random Forest and Support Vector Machine) do not lead to robust recognition accuracy, and so more advanced techniques should be used instead, possibly incorporating additional sensor features.

AB - Augmenting arbitrary physical objects with digital content leads to the missing interface problem, because those objects were never designed to incorporate such digital content and so they lack a user interface. A review of related work reveals that current approaches fail due to limited detection fidelity and spatial resolution. Our proposal, based on Google Soli's radar sensing technology, is designed to detect micro-gestures on objects with sub-millimeter precision. Preliminary results with a custom gesture set show that Soli's core features and traditional machine learning models (Random Forest and Support Vector Machine) do not lead to robust recognition accuracy, and so more advanced techniques should be used instead, possibly incorporating additional sensor features.

KW - Augmented Reality

KW - Google Soli

KW - Micro-gesture Recognition

KW - Millimeter-wave Radar

UR - http://www.scopus.com/inward/record.url?scp=85067294627&partnerID=8YFLogxK

U2 - 10.1145/3290607.3312986

DO - 10.1145/3290607.3312986

M3 - Abstract

AN - SCOPUS:85067294627

Y2 - 4 May 2019 through 9 May 2019

ER -