학술논문

Identifying Stable Components of Matrix /Tensor Factorizations via Low-Rank Approximation of Inter-Factorization Similarity
Document Type
Conference
Source
2019 27th European Signal Processing Conference (EUSIPCO) Signal Processing Conference (EUSIPCO), 2019 27th European. :1-5 Sep, 2019
Subject
Communication, Networking and Broadcast Technologies
Computing and Processing
Signal Processing and Analysis
Matrix decomposition
Tensors
Optimization
Signal processing algorithms
Silicon
Europe
Signal processing
Language
ISSN
2076-1465
Abstract
Many interesting matrix decompositions/factorizations, and especially many tensor decompositions, have to be solved by non-convex optimization-based algorithms, that may converge to local optima. Hence, when interpretability of the components is a requirement, practitioners have to compute the decomposition (e.g. CPD) many times, with different initializations, to verify whether the components are reproducible over repetitions of the optimization. However, it is non-trivial to assess such reliability or stability when multiple local optima are encountered. We propose an efficient algorithm that clusters the different repetitions of the decomposition according to the local optimum that they belong to, offering a diagnostic tool to practitioners. Our algorithm employs a graph-based representation of the decomposition, in which every repetition corresponds to a node, and similarities between components are encoded as edges. Clustering is then performed by exploiting a property known as cycle consistency, leading to a low-rank approximation of the graph. We demonstrate the applicability of our method on realistic electroencephalographic (EEG) data and synthetic data.