학술논문

Fast 3D Human Pose Estimation Using RF Signals
Document Type
Conference
Source
ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2023 - 2023 IEEE International Conference on. :1-5 Jun, 2023
Subject
Bioengineering
Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Radio frequency
Heating systems
Solid modeling
Three-dimensional displays
Portable computers
Computational modeling
Pose estimation
Human Pose Estimation
RF Sensing
Lightweight Deep Learning Model
Language
ISSN
2379-190X
Abstract
Existing deep learning-based wireless sensing models usually require intensive computation. In this paper, we introduce a lightweight RF-based 3D human pose estimation model, i.e., Fast RFPose, to enable real-time human pose estimation. Specifically, Fast RFPose first estimates the human locations in the RF heatmap and crops the human location regions, then estimates the fine-grained human poses based on the cropped small RF heatmaps. In the experiments, we build a radio system and a multi-view camera system to acquire the RF signals and the ground-truth human poses, and compare Fast RFPose with state-of-the-art methods. Experimental results demonstrate that Fast RFPose outperforms the alternative methods. Besides, we further deploy the trained Fast RFPose model on a laptop with a CPU and Fast RFPose can achieve 66 FPS processing speed, which means it can meet the real-time running requirements in mobile devices.