학술논문

Space-Time Domain Tensor Neural Networks: An Application on Human Pose Classification
Document Type
Conference
Source
2020 25th International Conference on Pattern Recognition (ICPR) Pattern Recognition (ICPR), 2020 25th International Conference on. :4688-4695 Jan, 2021
Subject
Computing and Processing
Signal Processing and Analysis
Training
Solid modeling
Protocols
Tensors
Three-dimensional displays
Neural networks
Data models
Language
Abstract
Recent advances in sensing technologies require the design and development of pattern recognition models capable of processing spatiotemporal data efficiently. In this study, we propose a spatially and temporally aware tensor-based neural network for human pose classification using three-dimensional skeleton data. Our model employs three novel components. First, an input layer capable of constructing highly discriminative spatiotemporal features. Second, a tensor fusion operation that produces compact yet rich representations of the data, and third, a tensor-based neural network that processes data representations in their original tensor form. Our model is end-to-end trainable and characterized by a small number of trainable parameters making it suitable for problems where the annotated data is limited. Experimental evaluation of the proposed model indicates that it can achieve state-of-the-art performance.