LGOct 16, 2024

Perseus: Leveraging Common Data Patterns with Curriculum Learning for More Robust Graph Neural Networks

arXiv:2410.12425v1h-index: 3
Originality Incremental advance
AI Analysis

This addresses the problem of adversarial robustness in GNNs for applications like social networks or recommendation systems, representing an incremental improvement over existing defense methods.

The paper tackles the vulnerability of Graph Neural Networks (GNNs) to adversarial attacks by proposing Perseus, a curriculum learning-based defense method that assesses edge difficulty and adjusts learning order to focus on common data patterns, resulting in models that achieve superior performance and significantly improved robustness.

Graph Neural Networks (GNNs) excel at handling graph data but remain vulnerable to adversarial attacks. Existing defense methods typically rely on assumptions like graph sparsity and homophily to either preprocess the graph or guide structure learning. However, preprocessing methods often struggle to accurately distinguish between normal edges and adversarial perturbations, leading to suboptimal results due to the loss of valuable edge information. Robust graph neural network models train directly on graph data affected by adversarial perturbations, without preprocessing. This can cause the model to get stuck in poor local optima, negatively affecting its performance. To address these challenges, we propose Perseus, a novel adversarial defense method based on curriculum learning. Perseus assesses edge difficulty using global homophily and applies a curriculum learning strategy to adjust the learning order, guiding the model to learn the full graph structure while adaptively focusing on common data patterns. This approach mitigates the impact of adversarial perturbations. Experiments show that models trained with Perseus achieve superior performance and are significantly more robust to adversarial attacks.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes