학술논문

Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features
Document Type
article
Source
IEEE Access, Vol 7, Pp 19199-19211 (2019)
Subject
3D reconstruction
mixed features
nonrigid registration
visible/infrared combined
Electrical engineering. Electronics. Nuclear engineering
TK1-9971
Language
English
ISSN
2169-3536
Abstract
When traditional 3D reconstruction techniques were used to reconstruct a scene with hidden and disguised heat source targets, the reconstructed scene could not contain these targets; thus, we could not recognize them. The disadvantages of such problems are particularly acute in the military and remote-sensing areas. For this application problem, the authors proposed a visible/infrared combined 3D reconstruction scheme. The 3D scene containing thermal radiation information could be reconstructed by fusing the data from RGB optical and infrared images combined with computer vision passive optical 3D scene reconstruction technique. Meanwhile, the authors proposed the nonrigid registration of multi-modality images with mixed features to solve the problem that the registration algorithm, which is widely used in traditional passive reconstruction technology, cannot accurately match visible and infrared images. Registration accuracy was improved by approximately 40%, experimental results showed that the visible/infrared combined 3D reconstruction scenes retain the visual reality of the traditional 3D reconstruction, and the hidden targets are highlighted in the scenes, which is conducive to the detection and recognition of interesting targets.