학술논문

Spatio-Temporal Graph-RNN for Point Cloud Prediction
Document Type
Conference
Source
2021 IEEE International Conference on Image Processing (ICIP) Image Processing (ICIP), 2021 IEEE International Conference on. :3428-3432 Sep, 2021
Subject
Computing and Processing
Signal Processing and Analysis
Geometry
Three-dimensional displays
Correlation
Network topology
Simulation
Dynamics
Transform coding
Point Cloud
Graph-based representation learning
Point-based models
Language
ISSN
2381-8549
Abstract
In this paper, we propose an end-to-end learning network to predict future frames in a point cloud sequence. As main novelty, an initial layer learns topological information of point clouds as geometric features, to form representative spatiotemporal neighborhoods. This module is followed by multiple Graph-RNN cells. Each cell learns point dynamics (i.e., RNN states) by processing each point jointly with its spatiotemporal neighbours. We tested the network performance with a MNIST dataset of moving digits, a synthetic human bodies motions, and JPEG dynamic bodies datasets. Simulation results demonstrate that our method outperforms baseline ones, which neglect geometry features information.