학술논문

RF-Sign: Position-Independent Sign Language Recognition Using Passive RFID Tags
Document Type
Periodical
Source
IEEE Internet of Things Journal IEEE Internet Things J. Internet of Things Journal, IEEE. 11(5):9056-9071 Mar, 2024
Subject
Computing and Processing
Communication, Networking and Broadcast Technologies
Gesture recognition
Assistive technologies
Antennas
Radiofrequency identification
Wireless sensor networks
Wireless communication
Sensors
Finger micromovements
radio-frequency identification (RFID)
received signal strength (RSS)
sign language
Language
ISSN
2327-4662
2372-2541
Abstract
Nowadays, sign language is becoming increasingly important in people’s daily life. Existing solutions are often based on wireless signals (e.g., acoustic, visible, and WiFi) or wearable sensors to recognize gestures, but they suffer from vulnerability to environmental influences, poor security, and high energy consumption, which prevent them from accurately capturing finger micromovements. In this article, we propose RF-Sign, which uses passive radio-frequency identification (RFID) tags to capture multiple finger micromovements simultaneously to enable sign language support. In particular, two main issues are studied. One is the problem of positional differences when users make the same gesture, and the other is the problem of segmenting consecutive gestures using only empirical thresholding methods and ignoring the existence of differences in thresholds for different gestures. For position differences, we propose position models to normalize the hand’s horizontal rotation angle and radial distance. For segmenting consecutive gestures, we use the received signal strength (RSS) trend of the reference tag to represent the finger micromovements state. The experimental results show that the average accuracy reaches 92.81% under different angles, distances, and other conditions.