학술논문

Image rectangling network based on reparameterized transformer and assisted learning
Document Type
article
Source
Scientific Reports, Vol 14, Iss 1, Pp 1-11 (2024)
Subject
Image rectangling
Single wrap
Re-parameterization
Assisted learning
Medicine
Science
Language
English
ISSN
2045-2322
Abstract
Abstract Stitched images can offer a broader field of view, but their boundaries can be irregular and unpleasant. To address this issue, current methods for rectangling images start by distorting local grids multiple times to obtain rectangular images with regular boundaries. However, these methods can result in content distortion and missing boundary information. We have developed an image rectangling solution using the reparameterized transformer structure, focusing on single distortion. Additionally, we have designed an assisted learning network to aid in the process of the image rectangling network. To improve the network’s parallel efficiency, we have introduced a local thin-plate spline Transform strategy to achieve efficient local deformation. Ultimately, the proposed method achieves state-of-the-art performance in stitched image rectangling with a low number of parameters while maintaining high content fidelity. The code is available at https://github.com/MelodYanglc/TransRectangling .