Greener GRASS: Enhancing GNNs with Encoding, Rewiring, and Attention
This work addresses the challenge of enhancing GNNs for machine learning tasks on graphs, representing an incremental improvement through synergistic combination of existing techniques.
The paper tackled the problem of improving Graph Neural Networks (GNNs) for graph-structured data by introducing GRASS, a novel architecture combining encoding, rewiring, and attention, resulting in state-of-the-art performance such as a 20.3% reduction in mean absolute error on the ZINC dataset.
Graph Neural Networks (GNNs) have become important tools for machine learning on graph-structured data. In this paper, we explore the synergistic combination of graph encoding, graph rewiring, and graph attention, by introducing Graph Attention with Stochastic Structures (GRASS), a novel GNN architecture. GRASS utilizes relative random walk probabilities (RRWP) encoding and a novel decomposed variant (D-RRWP) to efficiently capture structural information. It rewires the input graph by superimposing a random regular graph to enhance long-range information propagation. It also employs a novel additive attention mechanism tailored for graph-structured data. Our empirical evaluations demonstrate that GRASS achieves state-of-the-art performance on multiple benchmark datasets, including a 20.3% reduction in mean absolute error on the ZINC dataset.