학술논문

DeFlow: Self-supervised 3D Motion Estimation of Debris Flow
Document Type
Conference
Source
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) CVPRW Computer Vision and Pattern Recognition Workshops (CVPRW), 2023 IEEE/CVF Conference on. :6508-6517 Jun, 2023
Subject
Computing and Processing
Engineering Profession
Training
Computer vision
Solid modeling
Three-dimensional displays
Motion estimation
Source coding
Estimation
Language
ISSN
2160-7516
Abstract
Existing work on scene flow estimation focuses on autonomous driving and mobile robotics, while automated solutions are lacking for motion in nature, such as that exhibited by debris flows. We propose DeFlow, a model for 3D motion estimation of debris flows, together with a newly captured dataset. We adopt a novel multi-level sensor fusion architecture and self-supervision to incorporate the inductive biases of the scene. We further adopt a multi-frame temporal processing module to enable flow speed estimation over time. Our model achieves state-of-the-art optical flow and depth estimation on our dataset, and fully automates the motion estimation for debris flows. Source code and dataset are available at project page.