학술논문

LAAT: Locally Aligned Ant Technique for Discovering Multiple Faint Low Dimensional Structures of Varying Density
Document Type
Periodical
Source
IEEE Transactions on Knowledge and Data Engineering IEEE Trans. Knowl. Data Eng. Knowledge and Data Engineering, IEEE Transactions on. 35(6):6014-6027 Jun, 2023
Subject
Computing and Processing
Manifolds
Noise reduction
Manifold learning
Point cloud compression
Noise measurement
Eigenvalues and eigenfunctions
Clustering algorithms
Ant algorithm
Markov chain
multiple manifold detection
evolutionary computation
Language
ISSN
1041-4347
1558-2191
2326-3865
Abstract
Dimensionality reduction and clustering are often used as preliminary steps for many complex machine learning tasks. The presence of noise and outliers can deteriorate the performance of such preprocessing and therefore impair the subsequent analysis tremendously. In manifold learning, several studies indicate solutions for removing background noise or noise close to the structure when the density is substantially higher than that exhibited by the noise. However, in many applications, including astronomical datasets, the density varies alongside manifolds that are buried in a noisy background. We propose a novel method to extract manifolds in the presence of noise based on the idea of Ant colony optimization. In contrast to the existing random walk solutions, our technique captures points that are locally aligned with major directions of the manifold. Moreover, we empirically show that the biologically inspired formulation of ant pheromone reinforces this behavior enabling it to recover multiple manifolds embedded in extremely noisy data clouds. The algorithm performance in comparison to state-of-the-art approaches for noise reduction in manifold detection and clustering is demonstrated, on several synthetic and real datasets, including an N-body simulation of a cosmological volume.