학술논문

ICIHRN: An Interpretable Multilabel Hash Retrieval Method for Satellite Cloud Images
Document Type
Periodical
Author
Source
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing IEEE J. Sel. Top. Appl. Earth Observations Remote Sensing Selected Topics in Applied Earth Observations and Remote Sensing, IEEE Journal of. 17:8662-8672 2024
Subject
Geoscience
Signal Processing and Analysis
Power, Energy and Industry Applications
Clouds
Feature extraction
Remote sensing
Codes
Image retrieval
Satellites
Semantics
Cloud image retrieval
feature extraction
feature fusion
hash learning
interpretability
Language
ISSN
1939-1404
2151-1535
Abstract
Observing clouds to understand the weather is a crucial method for people to forecast upcoming conditions. Utilizing content-based satellite cloud image retrieval allows for the swift discovery of comparable historical cloud images, significantly aiding meteorologists in their advanced investigations. Nevertheless, satellite cloud images often present complexities due to their inclusion of diverse cloud types, leading to inadequate retrieval outcomes when relying on conventionally employed single-label retrieval techniques. Despite notable accomplishments in cloud image retrieval applications utilizing deep neural networks, concerns regarding network interpretability undermine confidence in the model's deductive outcomes. This article introduces the interpretable cloud image hash retrieval network, a framework that employs a singular object-level global unit alongside multiple local feature units for the purpose of generating hash codes tailored to cloud image retrieval. Furthermore, an attention branching network is incorporated to enhance the model's focus on discriminative regions within the image. In addition, a suppression module is implemented to progressively uncover complementary regions through the suppression of prominent areas in preceding layers and the amalgamation of relationships among activated regions. This ensures that each feature unit is endowed with distinctive semantic information, thereby imparting a level of interpretability to the retrieval outcomes. On this foundation, multilabel supervision is seamlessly integrated into the deep hash learning framework. This integration not only enhances the depiction of intricate semantic contents within cloud images but also boosts retrieval efficiency. Comprehensive experimental outcomes, grounded in the publicly accessible satellite cloud map dataset LSCIDMR-V2, demonstrate superior performance relative to other methods.