Direction-agnostic gesture recognition system using commercial WiFi devices

Yuxi Qin, Stephan Sigg, Su Pan*, Zibo Li

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

1 Citation (Scopus)

Abstract

In recent years, channel state information (CSI) has been used to recognize hand gestures for contactless human–computer interaction. However, most existing solutions require precision hardware or prior learning at the same angle both during training and for inference/training in order to achieve high recognition accuracy. This requirement is unrealistic for practical instrumentation, where the orientation of a subject relative to the RF receiver may be arbitrary. We present direction-agnostic hand gesture recognition utilizing commercial WiFi devices to overcome low accuracy in non-trained observation angles. To achieve equal conditions in all recognition angles, first of all, through the circular antenna arrangement to mitigate the impact of user direction changes. Then, the orientation of users is estimated by the Fresnel zone model. Finally, the feature mapping model of users in different orientations is established, and the gesture features in the estimated direction are mapped to the benchmark direction to eliminate the influence caused by the change of user orientation. Experimental results in a typical indoor environment show that WiNDR has superior performance, and the average recognition accuracy of five common gestures is 92.38%.

Original languageEnglish
Pages (from-to)34-44
Number of pages11
JournalComputer Communications
Volume216
DOIs
Publication statusPublished - 15 Feb 2024
MoE publication typeA1 Journal article-refereed

Keywords

  • Channel state information
  • Direction-agnostic
  • Hand gesture recognition

Fingerprint

Dive into the research topics of 'Direction-agnostic gesture recognition system using commercial WiFi devices'. Together they form a unique fingerprint.

Cite this