학술논문

Efficient Human Rendering with Geometric and Semantic Priors
Document Type
Conference
Source
2023 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) Broadband Multimedia Systems and Broadcasting (BMSB), 2023 IEEE International Symposium on. :1-6 Jun, 2023
Subject
Communication, Networking and Broadcast Technologies
Three-dimensional displays
Semantics
Pipelines
Manuals
Broadcasting
Rendering (computer graphics)
Cameras
Neural radiance field
multiview camera
human rendering
geometric prior
semantic prior
Language
ISSN
2155-5052
Abstract
Recently, human rendering has attracted many attention thanks to its vast applications. With new advances in neural rendering and radiance field, synthesizing realistic novel view images from multi-view camera images can be achived with less manual labour. However, due to the data-driven nature of such algorithms, the efficiency for both time and computation can be unsatisfying. Hence, we propose an efficient human rendering pipeline, generating geometric and semantic guidances as priors to further enhance both efficiency and quality. Specifically, a semantic human part parsing guides the pixel sampling in 2D space, and a mesh prior is utilized to guide an occupancy field for effective ray sampling in 3D space. As a result, we achieved considerable improvement over previous methods in both efficiency and rendering quality.