SILGDec 14, 2023

Efficient and Scalable Graph Generation through Iterative Local Expansion

arXiv:2312.11529v441 citationsh-index: 25ICLR
Originality Incremental advance
AI Analysis

This addresses scalability issues in graph generation for domains like social networks or biology, though it is incremental as it builds on existing diffusion methods.

The paper tackles the problem of generating large graphs efficiently by introducing a method that iteratively expands nodes using denoising diffusion, achieving state-of-the-art performance on benchmarks and scaling to graphs with at least 5000 nodes.

In the realm of generative models for graphs, extensive research has been conducted. However, most existing methods struggle with large graphs due to the complexity of representing the entire joint distribution across all node pairs and capturing both global and local graph structures simultaneously. To overcome these issues, we introduce a method that generates a graph by progressively expanding a single node to a target graph. In each step, nodes and edges are added in a localized manner through denoising diffusion, building first the global structure, and then refining the local details. The local generation avoids modeling the entire joint distribution over all node pairs, achieving substantial computational savings with subquadratic runtime relative to node count while maintaining high expressivity through multiscale generation. Our experiments show that our model achieves state-of-the-art performance on well-established benchmark datasets while successfully scaling to graphs with at least 5000 nodes. Our method is also the first to successfully extrapolate to graphs outside of the training distribution, showcasing a much better generalization capability over existing methods.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes