LGAIJan 22, 2024

Tensor-view Topological Graph Neural Network

arXiv:2401.12007v322 citationsh-index: 3AISTATS
Originality Incremental advance
AI Analysis

This work solves the problem of improving graph classification accuracy and efficiency for researchers and practitioners in machine learning, though it appears incremental as it builds upon existing techniques like persistent homology and graph convolution.

The paper tackles the problem of graph classification by addressing the limitations of existing GNNs, which rely on local information and suffer from multi-modal information loss and computational overhead, resulting in a method that outperforms 20 state-of-the-art methods on various benchmarks.

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems. Despite their state-of-the-art performances, existing GNNs only use local information from a very limited neighborhood around each node, suffering from loss of multi-modal information and overheads of excessive computation. To address these issues, we propose a novel Tensor-view Topological Graph Neural Network (TTG-NN), a class of simple yet effective topological deep learning built upon persistent homology, graph convolution, and tensor operations. This new method incorporates tensor learning to simultaneously capture Tensor-view Topological (TT), as well as Tensor-view Graph (TG) structural information on both local and global levels. Computationally, to fully exploit graph topology and structure, we propose two flexible TT and TG representation learning modules that disentangle feature tensor aggregation and transformation and learn to preserve multi-modal structure with less computation. Theoretically, we derive high probability bounds on both the out-of-sample and in-sample mean squared approximation errors for our proposed Tensor Transformation Layer (TTL). Real data experiments show that the proposed TTG-NN outperforms 20 state-of-the-art methods on various graph benchmarks.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes