LGSIMLNov 19, 2019

Heterogeneous Deep Graph Infomax

arXiv:1911.08538v5126 citations
Originality Incremental advance
AI Analysis

This addresses the problem of learning from heterogeneous graphs for researchers and practitioners in graph machine learning, representing an incremental improvement over existing methods.

The paper tackles unsupervised representation learning for heterogeneous graphs by proposing HDGI, which uses meta-paths and maximizes local-global mutual information, achieving state-of-the-art performance in classification and clustering tasks and comparable results to supervised models.

Graph representation learning is to learn universal node representations that preserve both node attributes and structural information. The derived node representations can be used to serve various downstream tasks, such as node classification and node clustering. When a graph is heterogeneous, the problem becomes more challenging than the homogeneous graph node learning problem. Inspired by the emerging information theoretic-based learning algorithm, in this paper we propose an unsupervised graph neural network Heterogeneous Deep Graph Infomax (HDGI) for heterogeneous graph representation learning. We use the meta-path structure to analyze the connections involving semantics in heterogeneous graphs and utilize graph convolution module and semantic-level attention mechanism to capture local representations. By maximizing local-global mutual information, HDGI effectively learns high-level node representations that can be utilized in downstream graph-related tasks. Experiment results show that HDGI remarkably outperforms state-of-the-art unsupervised graph representation learning methods on both classification and clustering tasks. By feeding the learned representations into a parametric model, such as logistic regression, we even achieve comparable performance in node classification tasks when comparing with state-of-the-art supervised end-to-end GNN models.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes