학술논문

Cross-Spectral Neural Radiance Fields
Document Type
Conference
Source
2022 International Conference on 3D Vision (3DV) 3DV 3D Vision (3DV), 2022 International Conference on. :606-616 Sep, 2022
Subject
Computing and Processing
Image sensors
Training
Image resolution
Three-dimensional displays
Sensitivity
Image color analysis
Lightning
Language
ISSN
2475-7888
Abstract
We propose X-NeRF, a novel method to learn a Cross-Spectral scene representation given images captured from cameras with different light spectrum sensitivity, based on the Neural Radiance Fields formulation. X-NeRF optimizes camera poses across spectra during training and exploits Normalized Cross-Device Coordinates (NXDC) to render images of different modalities from arbitrary viewpoints, which are aligned and at the same resolution. Experiments on 16 forward-facing scenes, featuring color, multi-spectral and infrared images, confirm the effectiveness of X-NeRF at modeling Cross-Spectral scene representations.