학술논문

Exploiting Learned Symmetries in Group Equivariant Convolutions
Document Type
Conference
Source
2021 IEEE International Conference on Image Processing (ICIP) Image Processing (ICIP), 2021 IEEE International Conference on. :759-763 Sep, 2021
Subject
Computing and Processing
Signal Processing and Analysis
Convolutional codes
Deep learning
Image processing
Conferences
Convolutional neural networks
group equivariant convolutions
depth-wise separable convolutions
efficient deep learning
Language
ISSN
2381-8549
Abstract
Group Equivariant Convolutions (GConvs) enable convolutional neural networks to be equivariant to various transformation groups, but at an additional parameter and compute cost. We investigate the filter parameters learned by GConvs and find certain conditions under which they become highly redundant. We show that GConvs can be efficiently decomposed into depthwise separable convolutions while preserving equivariance properties and demonstrate improved performance and data efficiency on two datasets. All code is publicly available at github.com/Attila94/SepGrouPy.