Deep Sensing: Inertial and Ambient Sensing for Activity Context Recognition using Deep Convolutional Neural Networks

OTEBOLAKU, Abayomi, ENAMAMU, Timibloudi, ALFOUDI, Ali, IKPEHAI, Augustine, MARCHANG, Jims and LEE, Gyu Myoung (2020). Deep Sensing: Inertial and Ambient Sensing for Activity Context Recognition using Deep Convolutional Neural Networks. Sensors, 20 (13), e3803.

Preview

PDF Otebolaku_.DeepSensingInertial(VoR)pdf.pdf - Published Version Creative Commons Attribution. Download (7MB) | Preview

Abstract

With the widespread use of embedded sensing capabilities of mobile devices, there has been unprecedented development of context-aware solutions. This allows the proliferation of various intelligent applications, such as those for remote health and lifestyle monitoring, intelligent personalized services, etc. However, activity context recognition based on multivariate time series signals obtained from mobile devices in unconstrained conditions is naturally prone to imbalance class problems. This means that recognition models tend to predict classes with the majority number of samples whilst ignoring classes with the least number of samples, resulting in poor generalization. To address this problem, we propose augmentation of the time series signals from inertial sensors with signals from ambient sensing to train deep convolutional neural network (DCNNs) models. DCNNs provide the characteristics that capture local dependency and scale invariance of these combined sensor signals. Consequently, we developed a DCNN model using only inertial sensor signals and then developed another model that combined signals from both inertial and ambient sensors aiming to investigate the class imbalance problem by improving the performance of the recognition model. Evaluation and analysis of the proposed system using data with imbalanced classes show that the system achieved better recognition accuracy when data from inertial sensors are combined with those from ambient sensors, such as environmental noise level and illumination, with an overall improvement of 5.3% accuracy.

Item Type:	Article
Uncontrolled Keywords:	0502 Environmental Science and Management; 0602 Ecology; 0301 Analytical Chemistry; 0805 Distributed Computing; 0906 Electrical and Electronic Engineering; Analytical Chemistry
Identification Number:	https://doi.org/10.3390/s20133803
Page Range:	e3803
SWORD Depositor:	Symplectic Elements
Depositing User:	Symplectic Elements
Date Deposited:	06 Jul 2020 13:39
Last Modified:	18 Mar 2021 00:15
URI:	https://shura.shu.ac.uk/id/eprint/26568

Actions (login required)

View Item

Downloads

Publication Metrics