Improving Cross-Subject Activity Recognition via Adversarial Learning

Research output: Contribution to journalArticleScientificpeer-review

13 Downloads (Pure)

Abstract

Deep learning has been widely used for implementing human activity recognition from wearable sensors like inertial measurement units. The performance of deep activity recognition is heavily affected by the amount and variability of the labeled data available for training the deep learning models. On the other hand, it is costly and time-consuming to collect and label data. Given limited training data, it is hard to maintain high performance across a wide range of subjects, due to the differences in the underlying data distribution of the training and the testing sets. In this work, we develop a novel solution that applies adversarial learning to improve cross-subject performance by generating training data that mimic artificial subjects - i.e. through data augmentation - and enforcing the activity classifier to ignore subject-dependent information. Contrary to domain adaptation methods, our solution does not utilize any data from subjects of the test set (or target domain). Furthermore, our solution is versatile as it can be utilized together with any deep neural network as the classifier. Considering the open dataset PAMAP2, nearly 10% higher cross-subject performance in terms of F1-score can be achieved when training a CNN-LSTM-based classifier with our solution. A performance gain of 5% is also observed when our solution is applied to a state-of-the-art HAR classifier composed of a combination of inception neural network and recurrent neural network. We also investigate different influencing factors of classification performance (i.e. selection of sensor modalities, sampling rates and the number of subjects in the training data), and summarize a practical guideline for implementing deep learning solutions for sensor-based human activity recognition.
Original languageEnglish
Article number2169-3536
Pages (from-to)90542-90554
Number of pages13
JournalIEEE Access
Volume8
DOIs
Publication statusPublished - 11 May 2020
MoE publication typeA1 Journal article-refereed

Keywords

  • Human activity recognition
  • deep learning
  • adversarial learning
  • data augmentation
  • cross-subject performance

Fingerprint Dive into the research topics of 'Improving Cross-Subject Activity Recognition via Adversarial Learning'. Together they form a unique fingerprint.

  • Projects

    CEAMA: Cognitive Engine for Assembly and Maintenance Automation

    Xiao, Y., Lee, J., Byvshev, P., Pham, T., Nyman, P., Souza Leite, C., Pouta, E. & Wirtanen, S.

    01/08/201830/06/2020

    Project: Business Finland: New business from research ideas (TUTLI)

    Cite this