학술논문

Learning Disentangled Features for Nerf-Based Face Reconstruction
Document Type
Conference
Source
2023 IEEE International Conference on Image Processing (ICIP) Image Processing (ICIP), 2023 IEEE International Conference on. :1135-1139 Oct, 2023
Subject
Computing and Processing
Signal Processing and Analysis
Geometry
Three-dimensional displays
Codes
Semantics
Fitting
Rendering (computer graphics)
Computational efficiency
3D-aware face reconstruction
neural radiance fields (NeRF)
parametric face model
Language
Abstract
The 3D-aware parametric face model named HeadNeRF achieved advantages in rendering photo-realistic face images. However, it has two limitations: (1) it uses single-image fitting reconstruction that is slow and prone to overfitting; (2) it lacks explicit 3D geometry information, making using semantic facial-parts-based loss challenging. This paper presents a 3D-aware face reconstruction learning framework tailored for HeadNeRF to address the limitations. We train a face encoder network that can directly learn the disentangled features for facial reconstruction to address the first limitation. For the second limitation, we introduce a lightweight semantic face segmentation network and facial-parts-based loss function to improve the reconstruction accuracy and quality. Our experiments show that the proposed method achieves a low reconstruction time consumption and enhanced reconstruction accuracy. Project page: https://peizhiyan.github.io/docs/headnerf+