Fully Linear Graph Convolutional Networks for Semi-Supervised Learning and Clustering
This work addresses computational inefficiency in graph-based learning for researchers and practitioners, offering a simpler and faster alternative to existing methods, though it is incremental as it builds on linear models.
The paper tackles the problem of training graph convolutional networks efficiently by proposing FLGC, a fully linear model that uses a closed-form solution instead of gradient descent, achieving state-of-the-art accuracy and robustness on classification and clustering benchmarks.
This paper presents FLGC, a simple yet effective fully linear graph convolutional network for semi-supervised and unsupervised learning. Instead of using gradient descent, we train FLGC based on computing a global optimal closed-form solution with a decoupled procedure, resulting in a generalized linear framework and making it easier to implement, train, and apply. We show that (1) FLGC is powerful to deal with both graph-structured data and regular data, (2) training graph convolutional models with closed-form solutions improve computational efficiency without degrading performance, and (3) FLGC acts as a natural generalization of classic linear models in the non-Euclidean domain, e.g., ridge regression and subspace clustering. Furthermore, we implement a semi-supervised FLGC and an unsupervised FLGC by introducing an initial residual strategy, enabling FLGC to aggregate long-range neighborhoods and alleviate over-smoothing. We compare our semi-supervised and unsupervised FLGCs against many state-of-the-art methods on a variety of classification and clustering benchmarks, demonstrating that the proposed FLGC models consistently outperform previous methods in terms of accuracy, robustness, and learning efficiency. The core code of our FLGC is released at https://github.com/AngryCai/FLGC.