학술논문

Multispectral Satellite Image Generation Using StyleGAN3
Document Type
Periodical
Source
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing IEEE J. Sel. Top. Appl. Earth Observations Remote Sensing Selected Topics in Applied Earth Observations and Remote Sensing, IEEE Journal of. 17:4379-4391 2024
Subject
Geoscience
Signal Processing and Analysis
Power, Energy and Industry Applications
Generative adversarial networks
Training
Data models
Generators
Remote sensing
Computer architecture
Satellites
Generative adversarial network (GAN)
GeoFake
Sentinel-2
StyleGAN3
synthetic image generation
Language
ISSN
1939-1404
2151-1535
Abstract
Satellite-based remote sensing images are essential for Earth surface analysis, serving diverse purposes in both civilian and military domains. Satellite images are used for analysis and decision making and are considered a reliable source of information. Recently, the field of image generation has developed increasingly sophisticated techniques, such as generative neural models, usually known as generative adversarial networks (GANs), to create synthetic images from scratch that appear almost real. Generative models have traditionally been applied to RGB or grayscale images and have been used for generating fake images of faces, animals, or objects. Currently, there are few studies regarding the application of GAN to multispectral satellite images. This work aims to test GAN models against the generation of multispectral satellite images, and in particular, the work explores the ability of the state-of-the-art StyleGAN3 model to produce high-quality synthetic Sentinel-2 images. The work delves into the configuration, training process, and evaluation of StyleGAN3 using custom Sentinel-2 datasets. StyleGAN3 results are compared with those provided by the proGAN model, the only GAN model tested so far on multispectral satellite data. Evaluation methods include visual inspection, spectral signature analysis, and a modified Fréchet inception distance for quantitative assessment. Results show that StyleGAN3 outperforms proGAN model exhibiting visually pleasing images. The quantitative comparison shows that StyleGAN3 provides the best results in terms of FID scores, in particular the improvement compared to proGAN increases as the spatial extent and spectral dimension of the generated images increases.