Projects per year
Abstract
We present Tesla-Rapture, a gesture recognition system for sparse point clouds generated by mmWave Radars. State of the art gesture recognition models are either too resource consuming or not sufficiently accurate for the integration into real-life scenarios using wearable or constrained equipment such as IoT devices (e.g. Raspberry PI), XR hardware (e.g. HoloLens), or smart-phones. To tackle this issue, we have developed Tesla, a Message Passing Neural Network (MPNN) graph convolution approach for mmWave radar point clouds. The model outperforms the state of the art on three datasets in terms of accuracy while reducing the computational complexity and, hence, the execution time. In particular, the approach, is able to predict a gesture almost 8 times faster than the most accurate competitor. Our performance evaluation in different scenarios (environments, angles, distances) shows that Tesla generalizes well and improves the accuracy up to 20% in challenging scenarios, such as a through-wall setting and sensing at extreme angles. Utilizing Tesla, we develop Tesla-Rapture, a real-time implementation using a mmWave Radar on a Raspberry PI 4 and evaluate its accuracy and time-complexity. We also publish the source code, the trained models, and the implementation of the model for embedded devices.
Original language | English |
---|---|
Pages (from-to) | 4946-4960 |
Number of pages | 15 |
Journal | IEEE Transactions on Mobile Computing |
Volume | 22 |
Issue number | 8 |
Early online date | 2022 |
DOIs | |
Publication status | Published - Aug 2023 |
MoE publication type | A1 Journal article-refereed |
Keywords
- Gesture-recognition
- Graph-convolution
- Machine-learning
- mmwave radar
- Sensing
Fingerprint
Dive into the research topics of 'Tesla-Rapture: A Lightweight Gesture Recognition System from mmWave Radar Sparse Point Clouds'. Together they form a unique fingerprint.Projects
- 1 Finished
-
WINDMILL: Integrating Wireless Communication ENgineering and MachIne Learning
Tirkkonen, O. (Principal investigator), Salami, D. (Project Member), Sigg, S. (Project Member) & Kazemi, P. (Project Member)
01/01/2019 → 30/06/2023
Project: EU: MC
Equipment
Press/Media
-
New Findings from Aalto University in the Area of Technology Described (Tesla-rapture: a Lightweight Gesture Recognition System From Mmwave Radar Sparse Point Clouds)
23/08/2023
1 item of Media coverage
Press/Media: Media appearance