학술논문

Learning features in deep architectures with unsupervised kernel k-means
Document Type
Conference
Source
2013 IEEE Global Conference on Signal and Information Processing Global Conference on Signal and Information Processing (GlobalSIP), 2013 IEEE. :981-984 Dec, 2013
Subject
Signal Processing and Analysis
Kernel
Computer architecture
Computer vision
Training
Vectors
Speech recognition
Clustering algorithms
Language
Abstract
Deep learning technology and related algorithms have dramatically broken landmark records for a broad range of learning problems in vision, speech, audio, and text processing. Meanwhile, kernel methods have found common-place usage due to their nonlinear expressive power and elegant optimization formulation. Based on recent progress in learning high-level, class-specific features in unlabeled data, we improve upon the result by combining nonlinear kernels and multi-layer (deep) architecture, which we apply at scale. In particular, our experimentation is based on k-means with an RBF kernel, though it is a straightforward extension to other unsupervised clustering techniques and other reproducing kernel Hilbert spaces. With the proposed method, we discover features distilled from unorganized images. We augment high-level feature invariance by pooling techniques.