LGJul 8, 2022

Stability of Aggregation Graph Neural Networks

arXiv:2207.03678v210 citationsh-index: 30
Originality Incremental advance
AI Analysis

This work addresses stability issues in graph neural networks for researchers in graph-based machine learning, but it is incremental as it builds on existing stability analysis for GNNs.

The paper tackles the problem of analyzing the stability of aggregation graph neural networks (Agg-GNNs) under graph perturbations, deriving stability bounds and showing that these bounds depend on the filters in the first CNN layer, with numerical evidence provided.

In this paper we study the stability properties of aggregation graph neural networks (Agg-GNNs) considering perturbations of the underlying graph. An Agg-GNN is a hybrid architecture where information is defined on the nodes of a graph, but it is processed block-wise by Euclidean CNNs on the nodes after several diffusions on the graph shift operator. We derive stability bounds for the mapping operator associated to a generic Agg-GNN, and we specify conditions under which such operators can be stable to deformations. We prove that the stability bounds are defined by the properties of the filters in the first layer of the CNN that acts on each node. Additionally, we show that there is a close relationship between the number of aggregations, the filter's selectivity, and the size of the stability constants. We also conclude that in Agg-GNNs the selectivity of the mapping operators is tied to the properties of the filters only in the first layer of the CNN stage. This shows a substantial difference with respect to the stability properties of selection GNNs, where the selectivity of the filters in all layers is constrained by their stability. We provide numerical evidence corroborating the results derived, testing the behavior of Agg-GNNs in real life application scenarios considering perturbations of different magnitude.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes