학술논문

Touchless hand gesture UI with instantaneous responses
Document Type
Conference
Source
2012 19th IEEE International Conference on Image Processing Image Processing (ICIP), 2012 19th IEEE International Conference on. :1957-1960 Sep, 2012
Subject
Signal Processing and Analysis
Components, Circuits, Devices and Systems
Communication, Networking and Broadcast Technologies
Computing and Processing
Neurons
Voltage control
Thumb
Tracking
Radio frequency
Computational efficiency
Gesture recognition
User Interface
Neuromorphic processing
Language
ISSN
1522-4880
2381-8549
Abstract
In this paper we present a simple technique for real-time touchless hand gesture user interface (UI) for mobile devices based on a biologically inspired vision sensor, the dynamic vision sensor (DVS). The DVS can detect a moving object in a fast and cost effective way by outputting events asynchronously on edges of the object. The output events are spatiotemporally correlated by using novel event-driven processing algorithms based on leaky integrate-and-fire neurons to track a finger tip or to infer directions of hand swipe motions. The experimental results show that the proposed technique can achieve graphic UI capable finger tip tracking with milliseconds intervals and accurate hand swipe motion detection with negligible latency.