학술논문

Degradation Adaption Based Heterogeneous Face Hallucination
Document Type
Conference
Source
2023 4th International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE), 2023 4th International Conference on. :329-332 Aug, 2023
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Robotics and Control Systems
Signal Processing and Analysis
Degradation
Representation learning
Geometry
Image resolution
Image color analysis
Artificial neural networks
Generative adversarial networks
component
Heterogeneous face hallucination
facial priors transformation
generative adversarial network
contrastive learning
Language
Abstract
In real-world long-range surveillance systems, thermal face images captured from a distance suffer from low resolution and noise, posing challenges for thermal-to-visible face image translation. Current methods assume similar resolutions and noise-free conditions between thermal and visible images, limiting their applicability. To address these issues, we propose the Degradation Adaption Network (DANet), which synthesizes high-quality visible images from low-quality thermal images. DANet combines pretrained Generative Adversarial Network (GAN) blocks with a U-shaped deep neural network (DNN) to incorporate faithful facial priors, including geometry, facial textures, and colors. Additionally, an unsupervised degradation representation learning scheme is developed to capture abstract degradation representations of degraded thermal images in a representation space. This approach allows DANet to adapt spatial features based on the degradation representation, striking a balance between fidelity and texture faithfulness using degradation-aware feature fusion (DAFF) blocks. Experimental results demonstrate that DANet outperforms state-of-the-art methods, showing its effectiveness in handling real-world low-quality thermal images across diverse practical applications.