학술논문

CODE-IF: A Convex/Deep Image Fusion Algorithm for Efficient Hyperspectral Super-Resolution
Document Type
Periodical
Source
IEEE Transactions on Geoscience and Remote Sensing IEEE Trans. Geosci. Remote Sensing Geoscience and Remote Sensing, IEEE Transactions on. 62:1-18 2024
Subject
Geoscience
Signal Processing and Analysis
Hyperspectral imaging
Superresolution
Codes
Task analysis
Signal processing algorithms
Inverse problems
Convolutional neural networks
Convex optimization (CO)
deep learning (DE)
hyperspectral image (HSI)
image fusion
image super-resolution
Language
ISSN
0196-2892
1558-0644
Abstract
Super-resolving remotely acquired hyperspectral images (HSIs), often with low resolution (LR), is a critical signal-processing technique, as it greatly affects the subsequent material classification and identification tasks. An economical approach in the remote sensing area is to fuse the spatial details extracted from the high-resolution (HR) counterpart multispectral image (MSI) into the LR HSI, thereby inferring the desired HR HSI. Convex analysis is an effective tool for the fusion mission, but it often relies on sophisticated regularization schemes to tackle this challenging inverse problem. In the existing literature, the deep plug-and-play (PnP) strategy was proposed for fast implementation of those sophisticated regularizers, but just approximately without convergence guarantees. Thus, we introduce deep learning (in an alternative approach) to tailor a simple convex regularizer for efficient super-resolution. Remarkably, though typical deep fusion methods can tackle nonlinear effects presented in real hyperspectral data, they often rely on big data and sophisticated network structures, which are often time-consuming and resource-intensive. Instead, our deep regularizer just needs a small-data-driven simple network architecture that implies better stability and tractability; we achieve so by reconsidering the role of deep learning as simply to guide the convex algorithm to search the fusion solution, rather than directly serving as the final solution. The proposed convex/deep image fusion (CODE-IF) algorithm, with all the closed-form algorithmic expressions derived, achieves state-of-the-art hyperspectral super-resolution (HSR) performance.