학술논문
Thermal and Visible Image Registration Using Deep Homography
Document Type
Conference
Author
Source
2022 25th International Conference on Information Fusion (FUSION) Information Fusion (FUSION), 2022 25th International Conference on. :1-8 Jul, 2022
Subject
Language
Abstract
Fusing thermal and visible images is a recurring challenge in computer vision, especially when the images of the two modalities are not well registered. This registration problem is traditionally solved by matching descriptors and depends on the richness and discriminating power of the representation. Ensuring that detected features are dense and uniformly distributed is not necessarily guaranteed. More recently, machine learning methods addressed the issue of visible to visible matching, but few address the multi-modality setting. In this paper, we propose to address the special case of thermal-visible image registration with small baseline parallax correction. Our deep homography model is evaluated on an open thermal and visible dataset with two training settings, unsupervised and supervised. Results demonstrate the feasibility of the approach, and performances comparison to state-of-the-art models is evaluated.