Graph Reinforcement Learning for Power Grids: A Comprehensive Survey
This is an incremental review paper that synthesizes existing research on GRL for power grids, addressing the need for more flexible control methods due to renewable energy integration, but it does not present new experimental results or breakthroughs.
The survey examines how Graph Reinforcement Learning (GRL) can enhance representation learning and decision-making in power grid applications, particularly for transmission and distribution grids, by analyzing graph structures, GNN architectures, and RL approaches, though it notes that current GRL methods are primarily proof-of-concept and not yet deployable in real-world settings.
The increasing share of renewable energy and distributed electricity generation requires the development of deep learning approaches to address the lack of flexibility inherent in traditional power grid methods. In this context, Graph Neural Networks are a promising solution due to their ability to learn from graph-structured data. Combined with Reinforcement Learning, they can be used as control approaches to determine remedial actions. This review analyses how Graph Reinforcement Learning can improve representation learning and decision-making in power grid applications, particularly transmission and distribution grids. We analyze the reviewed approaches in terms of the graph structure, the Graph Neural Network architecture, and the Reinforcement Learning approach. Although Graph Reinforcement Learning has demonstrated adaptability to unpredictable events and noisy data, its current stage is primarily proof-of-concept, and it is not yet deployable to real-world applications. We highlight the open challenges and limitations for real-world applications.