학술논문

High-Throughput Asynchronous Convolutions for High-Resolution Event-Cameras
Document Type
Conference
Source
2022 8th International Conference on Event-Based Control, Communication, and Signal Processing (EBCCSP) Event-Based Control, Communication, and Signal Processing (EBCCSP), 2022 8th International Conference on. :1-8 Jun, 2022
Subject
Bioengineering
Components, Circuits, Devices and Systems
Computing and Processing
General Topics for Engineers
Power, Energy and Industry Applications
Robotics and Control Systems
Signal Processing and Analysis
Visualization
Convolution
Pipelines
Process control
Streaming media
Cameras
Real-time systems
Event-Driven Cameras
Asynchronous Processing
Spatial Convolutions
Real-Time Processing
Language
Abstract
Event cameras are promising sensors for on-line and real-time vision tasks due to their high temporal resolution, low latency, and redundant static data elimination. Many vision algorithms use some form of spatial convolution (i.e. spatial pattern detection) as a fundamental component. However, additional consideration must be taken for event cameras, as the visual signal is asynchronous and sparse. While elegant methods have been proposed for event-based convolutions, they are unsuitable for real scenarios due to their inefficient processing pipeline and subsequent low event-throughput. This paper presents an efficient implementation based on decoupling the event-based computations from the computationally heavy convolutions, increasing the maximum event processing rate by 15. 92 × to over 10 million events/second, while still maintaining the event-based paradigm of asynchronous input and output. Results on public datasets with modern 640 × 480 event-camera recordings show that the proposed implementation achieves real-time processing with minimal impact on the convolution result, while the prior state-of-the-art results in a latency of over 1 second.