LGApr 30, 2022

Heterogeneous Graph Neural Networks using Self-supervised Reciprocally Contrastive Learning

MIT
arXiv:2205.00256v214 citationsh-index: 127
Originality Incremental advance
AI Analysis

This work addresses the costly annotation needs in heterogeneous graph analysis for researchers and practitioners, though it is incremental as it builds on existing contrastive learning methods.

The authors tackled the problem of requiring annotated data for heterogeneous graph neural networks by developing a self-supervised contrastive learning approach that integrates node attributes and graph topologies, achieving superior and robust performance over state-of-the-art methods on three large real-world graphs.

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be annotated, which is costly and time-consuming. Self-supervised contrastive learning has been proposed to address the problem of requiring annotated data by mining intrinsic information hidden within the given data. However, the existing contrastive learning methods are inadequate for heterogeneous graphs because they construct contrastive views only based on data perturbation or pre-defined structural properties (e.g., meta-path) in graph data while ignore the noises that may exist in both node attributes and graph topologies. We develop for the first time a novel and robust heterogeneous graph contrastive learning approach, namely HGCL, which introduces two views on respective guidance of node attributes and graph topologies and integrates and enhances them by reciprocally contrastive mechanism to better model heterogeneous graphs. In this new approach, we adopt distinct but most suitable attribute and topology fusion mechanisms in the two views, which are conducive to mining relevant information in attributes and topologies separately. We further use both attribute similarity and topological correlation to construct high-quality contrastive samples. Extensive experiments on three large real-world heterogeneous graphs demonstrate the superiority and robustness of HGCL over state-of-the-art methods.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes