학술논문

Luminance-Preserving Visible and Near-Infrared Image Fusion Network with Edge Guidance
Document Type
Conference
Source
2023 IEEE International Conference on Image Processing (ICIP) Image Processing (ICIP), 2023 IEEE International Conference on. :1155-1159 Oct, 2023
Subject
Computing and Processing
Signal Processing and Analysis
Knowledge engineering
Image quality
Deep learning
Image color analysis
Image edge detection
Neural networks
Distortion
near-infrared images
visible images
image fusion
deep learning
edge guidance
Language
Abstract
Near-infrared (NIR) images and visible (VIS) images can provide mutually complementary information for each other, thus the fusion of the two modalities can create images of high quality even in adverse conditions. However, the luminance of NIR and VIS images may be inconsistent in some regions, resulting in color distortion and unrealistic appearance in the fused images. The existing methods perform poorly at luminance retention. Aiming at the problem and based on deep learning framework, we propose an edge-guided method which can be applied to the image fusion network. Edge maps are utilized as prior knowledge of images to boost the performance of the neural network. Additionally, we propose a luminance-preserving loss function combined with max-edge loss to further improve the image quality. Experimental results show the superiority of our method.