Combined Vision and Wearable System for Daily Activity Recognition

LOIZZO, FGC, FIORINI, L, SORRENTINO, A, DI NUOVO, Alessandro, ROVINI, E and CAVALLO, F (2022). Combined Vision and Wearable System for Daily Activity Recognition. In: BETTELLI, Alice, MONTERIU, Andrea and GAMBERINI, Luciano, (eds.) Ambient Assisted Living. Italian Forum 2020. Lecture Notes in Electrical Engineering (884). Cham, Springer International Publishing, 216-234.

Preview

PDF (Version query) ForitAAL_revisionato (1).pdf - Submitted Version All rights reserved. Download (10MB) | Preview

Abstract

Social assistive robotics aims at improving the quality of life of elderly people and caregivers. Human Activity Recognition (HAR) is one of the capabilities the assistive robot should be endowed with, to allow aged people to independently live in their homes. This work deals with the problem of performing HAR by employing two wearable inertial sensors and one RGB-D camera, mounted on the social robot Pepper. Specifically, the main purpose is to prove that Pepper robot is able to correctly recognize daily living activities by exploiting the information coming from the RGB-D camera and one inertial sensor placed on the index finger of the subject. Ten users were asked to perform ten activities while wearing an inertial glove, SensHand, and while being recorded by the camera. Two different perspectives of the robot were studied to understand if a good activity recognition could be obtained when the robot is in front of the person and on his side. The results show that almost the same recognition performances are obtained when combining the visual sensor, no matter the chosen perspective, with the inertial sensor only on the index (95%), with respect to the fusion of the same camera with the inertial sensor on the index and on the wrist (96%). This supports the conclusion that elderly people could just wear a small ring on the index finger to allow the robot to recognize their activities, taking advantage from a system which is comfortable and easy-to-wear.

Item Type:	Book Section
Additional Information:	11th Italian Forum on Active and Assisted Living, ForltAAL 2020, Virtual Event, December. Series ISSN: 1876-1119
Identification Number:	https://doi.org/10.1007/978-3-031-08838-4_16
Page Range:	216-234
SWORD Depositor:	Symplectic Elements
Depositing User:	Symplectic Elements
Date Deposited:	06 Sep 2022 14:28
Last Modified:	11 Oct 2023 13:01
URI:	https://shura.shu.ac.uk/id/eprint/30676

Actions (login required)

View Item

Downloads

Publication Metrics