The missing interface: Micro-gestures on augmented objects

Klen Čopič Pucihar, Wolfgang Huerst, Hirokazu Kato, Christian Sandor, Alexander Plopski, Luis A. Leiva, Matjazč Kljun, Takafumi Taketomi

Research output: Contribution to conferenceAbstractScientificpeer-review

1 Citation (Scopus)


Augmenting arbitrary physical objects with digital content leads to the missing interface problem, because those objects were never designed to incorporate such digital content and so they lack a user interface. A review of related work reveals that current approaches fail due to limited detection fidelity and spatial resolution. Our proposal, based on Google Soli's radar sensing technology, is designed to detect micro-gestures on objects with sub-millimeter precision. Preliminary results with a custom gesture set show that Soli's core features and traditional machine learning models (Random Forest and Support Vector Machine) do not lead to robust recognition accuracy, and so more advanced techniques should be used instead, possibly incorporating additional sensor features.

Original languageEnglish
Publication statusPublished - 2 May 2019
MoE publication typeNot Eligible
EventACM SIGCHI Annual Conference on Human Factors in Computing Systems - Glasgow, United Kingdom
Duration: 4 May 20199 May 2019


ConferenceACM SIGCHI Annual Conference on Human Factors in Computing Systems
Abbreviated titleACM CHI
Country/TerritoryUnited Kingdom
Internet address


  • Augmented Reality
  • Google Soli
  • Micro-gesture Recognition
  • Millimeter-wave Radar


Dive into the research topics of 'The missing interface: Micro-gestures on augmented objects'. Together they form a unique fingerprint.

Cite this