Beyond Low-frequency Information in Graph Convolutional Networks
This work addresses the limitation of existing GNNs that primarily utilize low-frequency information, providing a more adaptable and effective model for researchers and practitioners working with graph data.
This paper investigates the importance of high-frequency information in Graph Neural Networks (GNNs), demonstrating that relying solely on low-frequency signals is insufficient for effective node representation. The authors propose Frequency Adaptation Graph Convolutional Networks (FAGCN), which adaptively integrates different frequency signals using a self-gating mechanism, outperforming state-of-the-art methods on six real-world networks.
Graph neural networks (GNNs) have been proven to be effective in various network-related tasks. Most existing GNNs usually exploit the low-frequency signals of node features, which gives rise to one fundamental question: is the low-frequency information all we need in the real world applications? In this paper, we first present an experimental investigation assessing the roles of low-frequency and high-frequency signals, where the results clearly show that exploring low-frequency signal only is distant from learning an effective node representation in different scenarios. How can we adaptively learn more information beyond low-frequency information in GNNs? A well-informed answer can help GNNs enhance the adaptability. We tackle this challenge and propose a novel Frequency Adaptation Graph Convolutional Networks (FAGCN) with a self-gating mechanism, which can adaptively integrate different signals in the process of message passing. For a deeper understanding, we theoretically analyze the roles of low-frequency signals and high-frequency signals on learning node representations, which further explains why FAGCN can perform well on different types of networks. Extensive experiments on six real-world networks validate that FAGCN not only alleviates the over-smoothing problem, but also has advantages over the state-of-the-arts.