학술논문
S-Divergence-Based Internal Clustering Validation Index
Document Type
Academic Journal
Source
International Journal of Interactive Multimedia and Artificial Intelligence. December, 2023, Vol. 8 Issue 4, p127, 13 p.
Subject
Language
English
ISSN
1989-1660
Abstract
I. INTRODUCTION CLUSTERING is an unsupervised methodology for analyzing a set of data objects by dividing them into subsets such that each group contains similar objects while dissimilar ones end […]
A clustering validation index (CVI) is employed to evaluate an algorithm's clustering results. Generally, CVI statistics can be split into three classes, namely internal, external, and relative cluster validations. Most of the existing internal CVIs were designed based on compactness (CM) and separation (SM). The distance between cluster centers is calculated by SM, whereas the CM measures the variance of the cluster. However, the SM between groups is not always captured accurately in highly overlapping classes. In this article, we devise a novel internal CVI that can be regarded as a complementary measure to the landscape of available internal CVIs. Initially, a database's clusters are modeled as a non-parametric density function estimated using kernel density estimation. Then the S-divergence (SD) and S-distance are introduced for measuring the SM and the CM, respectively. The SD is defined based on the concept of Hermitian positive definite matrices applied to density functions. The proposed internal CVI (PM) is the ratio of CM to SM. The PM outperforms the legacy measures presented in the literature on both superficial and realistic databases in various scenarios, according to empirical results from four popular clustering algorithms, including fuzzy k-means, spectral clustering, density peak clustering, and density-based spatial clustering applied to noisy data. KEYWORDS Cluster Validity Index, Generalized Mean, K-nearest Neighbors, S-distance, S-divergence, Spectral Clustering, Symmetry Favored.
A clustering validation index (CVI) is employed to evaluate an algorithm's clustering results. Generally, CVI statistics can be split into three classes, namely internal, external, and relative cluster validations. Most of the existing internal CVIs were designed based on compactness (CM) and separation (SM). The distance between cluster centers is calculated by SM, whereas the CM measures the variance of the cluster. However, the SM between groups is not always captured accurately in highly overlapping classes. In this article, we devise a novel internal CVI that can be regarded as a complementary measure to the landscape of available internal CVIs. Initially, a database's clusters are modeled as a non-parametric density function estimated using kernel density estimation. Then the S-divergence (SD) and S-distance are introduced for measuring the SM and the CM, respectively. The SD is defined based on the concept of Hermitian positive definite matrices applied to density functions. The proposed internal CVI (PM) is the ratio of CM to SM. The PM outperforms the legacy measures presented in the literature on both superficial and realistic databases in various scenarios, according to empirical results from four popular clustering algorithms, including fuzzy k-means, spectral clustering, density peak clustering, and density-based spatial clustering applied to noisy data. KEYWORDS Cluster Validity Index, Generalized Mean, K-nearest Neighbors, S-distance, S-divergence, Spectral Clustering, Symmetry Favored.