LGSIMay 14, 2023

Decoupled Graph Neural Networks for Large Dynamic Graphs

arXiv:2305.08273v127 citations
Originality Highly original
AI Analysis

This addresses the challenge of efficiently processing large dynamic graphs for applications like social networks and recommendation systems, offering a scalable and generalizable solution.

The paper tackles the problem of modeling dynamic graphs with both structural and temporal aspects by proposing a decoupled graph neural network that unifies continuous and discrete-time approaches, achieving state-of-the-art performance on seven real-world datasets and scaling to graphs with over a billion edges and a hundred million nodes.

Real-world graphs, such as social networks, financial transactions, and recommendation systems, often demonstrate dynamic behavior. This phenomenon, known as graph stream, involves the dynamic changes of nodes and the emergence and disappearance of edges. To effectively capture both the structural and temporal aspects of these dynamic graphs, dynamic graph neural networks have been developed. However, existing methods are usually tailored to process either continuous-time or discrete-time dynamic graphs, and cannot be generalized from one to the other. In this paper, we propose a decoupled graph neural network for large dynamic graphs, including a unified dynamic propagation that supports efficient computation for both continuous and discrete dynamic graphs. Since graph structure-related computations are only performed during the propagation process, the prediction process for the downstream task can be trained separately without expensive graph computations, and therefore any sequence model can be plugged-in and used. As a result, our algorithm achieves exceptional scalability and expressiveness. We evaluate our algorithm on seven real-world datasets of both continuous-time and discrete-time dynamic graphs. The experimental results demonstrate that our algorithm achieves state-of-the-art performance in both kinds of dynamic graphs. Most notably, the scalability of our algorithm is well illustrated by its successful application to large graphs with up to over a billion temporal edges and over a hundred million nodes.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes