학술논문

Optically Enhanced Super-Resolution of Sea Surface Temperature Using Deep Learning
Document Type
Periodical
Source
IEEE Transactions on Geoscience and Remote Sensing IEEE Trans. Geosci. Remote Sensing Geoscience and Remote Sensing, IEEE Transactions on. 60:1-14 2022
Subject
Geoscience
Signal Processing and Analysis
Remote sensing
Satellites
Spatial resolution
Ocean temperature
Earth
Artificial satellites
Optical imaging
Data fusion
deep learning
gyre
Landsat 8
ocean front
sea surface temperature (SST)
Sentinel 3
super-resolution (SR)
thermal infrared
Language
ISSN
0196-2892
1558-0644
Abstract
Sea surface temperature (SST) can be measured from space using infrared sensors on Earth-observing satellites. However, the tradeoff between spatial resolution and swath size (and hence revisit time) means that SST products derived from remote sensing measurements commonly only have a moderate resolution (>1 km). In this article, we adapt the design of a super-resolution neural network architecture [specifically very deep super-resolution (VDSR)] to enhance the resolution of both top-of-atmosphere thermal images of sea regions and bottom-of-atmosphere SST images by a factor of 5. When tested on an unseen dataset, the trained neural network yields thermal images that have an RMSE $2-3\times $ smaller than interpolation, with a 6–9 dB improvement in PSNR. A major contribution of the proposed neural network architecture is that it fuses optical and thermal images to propagate the high-resolution information present in the optical image to the restored thermal image. To illustrate the potential benefits of using super-resolution (SR) in the context of oceanography, we present super-resolved SST images of a gyre and an ocean front, revealing details and features otherwise poorly resolved by moderate resolution satellite images.