학술논문

Trajectory Features-Based Robust Device-Free Gesture Recognition Using mmWave Signals
Document Type
Periodical
Source
IEEE Internet of Things Journal IEEE Internet Things J. Internet of Things Journal, IEEE. 11(10):18123-18135 May, 2024
Subject
Computing and Processing
Communication, Networking and Broadcast Technologies
Trajectory
Gesture recognition
Feature extraction
Wireless communication
Millimeter wave communication
Training
Task analysis
Device-free
gesture recognition
mmWave signals
trajectory
Language
ISSN
2327-4662
2372-2541
Abstract
Device-free gesture recognition has attracted significant attention due to its potential applications in pervasive interaction. It enables gesture recognition in a device-free and contact-free manner by analyzing the influence pattern of human gestures on surrounding wireless signals, such as mmWave signals. Although remarkable progress has been achieved in this area, the recognition performance will degrade remarkably when gestures are conducted in different scenarios. In this article, we leverage mmWave signals to design two robust trajectory features, i.e., the trajectory image and the trajectory time-sequence features, that are independent of the conducted scenarios to solve the aforementioned problems. Specifically, we employ the particle filter algorithm to construct the raw trajectory image utilizing range measurements, rotate and enhance the image to obtain the trajectory image feature suitable for recognition by leveraging a public handwriting font image data set as the training set. Additionally, we derive the range of the trajectory relative to a stable point as the trajectory time-sequence feature. With these trajectory features, we design a deep network to perform the gesture recognition task. To validate the effectiveness of the proposed methods, we conduct extensive experiments on a 77GHz mmWave testbed. The results indicate that the two proposed trajectory features are feasible for achieving scenario-independent gesture recognition.