학술논문

Explainable, Stable, and Scalable Network Embedding Algorithms for Unsupervised Learning of Graph Representations
Document Type
Periodical
Author
Source
IEEE Transactions on Computational Social Systems IEEE Trans. Comput. Soc. Syst. Computational Social Systems, IEEE Transactions on. 10(5):2421-2438 Oct, 2023
Subject
Computing and Processing
Communication, Networking and Broadcast Technologies
General Topics for Engineers
Clustering algorithms
Approximation algorithms
Sparse matrices
Laplace equations
Probabilistic logic
Machine learning algorithms
Computational complexity
Eigenvectors
graph convolutional networks (GCNs)
graph neural networks (GNNs)
network embedding
network representation learning (NRL)
Language
ISSN
2329-924X
2373-7476
Abstract
Network embedding that maps nodes in a graph to vectors in a Euclidean space is a very powerful method to address various tasks on a graph. However, most network embedding algorithms, in particular, graph neural networks (GNNs), are difficult to interpret and do not scale well to handle millions of nodes. In this article, we tackle the problem from a new perspective based on the equivalence of three constrained optimization problems: the network embedding problem, the trace maximization problem of the modularity matrix in a sampled graph, and the matrix factorization problem of the modularity matrix in a sampled graph. The optimal solutions to these three problems are the dominant eigenvectors of the modularity matrix. We propose two unsupervised learning algorithms that belong to a special class of graph convolutional networks (GCNs) for solving these problems: 1) Clustering As Feature Embedding (CAFE) and 2) Sphere. Both algorithms are stable trace maximization algorithms and yield good approximations of dominant eigenvectors. Moreover, there are linear-time implementations for sparse graphs. Various experiments are conducted to evaluate our algorithms and show that our proposed algorithms outperform several baseline methods.