학술논문

Infrared video behavior recognition algorithm based on AGX Xavier environment
Document Type
Conference
Source
2023 CAA Symposium on Fault Detection, Supervision and Safety for Technical Processes (SAFEPROCESS) Fault Detection, Supervision and Safety for Technical Processes (SAFEPROCESS), 2023 CAA Symposium on. :1-5 Sep, 2023
Subject
Aerospace
Power, Energy and Industry Applications
Robotics and Control Systems
Signal Processing and Analysis
Transportation
Computational modeling
Surveillance
Fault detection
Neural networks
Streaming media
Cameras
Real-time systems
Behavior Recognition
TSM
Lightweight
Real-time
Infrared Surveillance Video
Language
Abstract
Analyzing human behavior recognition for infrared video is important since crimes are more likely to occur in nighttime environments. Therefore, this paper proposes an infrared video behavior recognition algorithm based on AGX Xavier, an edge device, using a TSM module embedded in a 2D neural network with temporal modeling capability, which can significantly reduce the number of model parameters and computational effort to achieve deployment on a lightweight edge device with cameras. Online behavior recognition is achieved. The method's accuracy is 91% on the dataset captured by the subject's active infrared camera. It is tested in real application scenarios, and the online recognition mode has low latency and high speed to meet the real-time behavior recognition requirements.