LGSIMay 2, 2024

Community-Invariant Graph Contrastive Learning

arXiv:2405.01350v118 citationsh-index: 11Has CodeICML
Originality Highly original
AI Analysis

This addresses the limitation of existing graph contrastive learning methods that corrupt high-level graph information like communities, improving robustness for graph representation learning tasks.

The paper tackles the problem of graph augmentation in graph contrastive learning by proposing a community-invariant framework that maintains graph community structure during augmentation, unifying topology and feature constraints to enhance robustness, achieving state-of-the-art results on 21 benchmark datasets.

Graph augmentation has received great attention in recent years for graph contrastive learning (GCL) to learn well-generalized node/graph representations. However, mainstream GCL methods often favor randomly disrupting graphs for augmentation, which shows limited generalization and inevitably leads to the corruption of high-level graph information, i.e., the graph community. Moreover, current knowledge-based graph augmentation methods can only focus on either topology or node features, causing the model to lack robustness against various types of noise. To address these limitations, this research investigated the role of the graph community in graph augmentation and figured out its crucial advantage for learnable graph augmentation. Based on our observations, we propose a community-invariant GCL framework to maintain graph community structure during learnable graph augmentation. By maximizing the spectral changes, this framework unifies the constraints of both topology and feature augmentation, enhancing the model's robustness. Empirical evidence on 21 benchmark datasets demonstrates the exclusive merits of our framework. Code is released on Github (https://github.com/ShiyinTan/CI-GCL.git).

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes