학술논문

Foreground Fusion-Based Liquefied Natural Gas Leak Detection Framework From Surveillance Thermal Imaging
Document Type
Periodical
Source
IEEE Transactions on Emerging Topics in Computational Intelligence IEEE Trans. Emerg. Top. Comput. Intell. Emerging Topics in Computational Intelligence, IEEE Transactions on. 7(4):1151-1162 Aug, 2023
Subject
Computing and Processing
Liquefied natural gas
Feature extraction
Sensors
Leak detection
Imaging
Convolution
Visualization
Natural gas industries
thermal imaging
background subtraction
visual surveillance
leak detection and repair survey
information fusion
Language
ISSN
2471-285X
Abstract
A leak detection and repair survey (LDAR) is essential to ensure a reliable and safe liquefied natural gas (LNG) supply. Modern LDAR systems deploy numerous fixed thermal imaging devices to automatically monitor the risk of potential leaks empowered by computational intelligence frameworks. Existing frameworks employ either background subtraction-based (BGS-based) or deep neural network-based (DNN-based) frameworks for LNG leak detection from thermal images. However, the BGS-based frameworks feature high sensitivity to perceive LNG emissions with low precision. On the contrary, the DNN-based frameworks can precisely classify the LNG leak after training while the sensitivity is low. Additionally, conventional DNN-based frameworks are difficult in modeling non-rigid objects such as LNG gas due to limited perceptive fields. Therefore, this study proposes a hybrid framework, namely foreground fusion-based gas detection (FFBGD), combining the advantages of BGS-based and DNN-based detectors for improved detection robustness through newly introduced concept of information fusion to LNG industries. Specifically, a foreground fusion network (FFN) is designed to fuse information of original thermal and foreground images after BGS based on the visual attention mechanism. Meanwhile, several advanced modules, i.e. deformable convolution, feature pyramid network, and cascade region-of-interest (ROI) head are adopted to enhance leak detection by offering better perceptive fields. Extensive experiments are carried out in this study to demonstrate the significant improvement brought by the proposed FFBGD over leak detection accuracy and robustness. Hence, the proposed solution can be deployed in energy facilities and enable reliable visual surveillance of LNG leaks.