Scaling Up without Fading Out: Goal-Aware Sparse GNN for RL-based Generalized Planning
This addresses scaling challenges in generalized planning for symbolic domains like PDDL, though it appears incremental as it builds on existing RL+GNN approaches.
The paper tackles the problem of combinatorial explosion and information dilution in graph neural networks for reinforcement learning-based generalized planning by proposing a sparse, goal-aware GNN representation that selectively encodes local relationships and integrates spatial goal features. The method scales effectively to larger grid sizes previously infeasible with dense representations and substantially improves policy generalization and success rates in drone mission scenarios.
Generalized planning using deep reinforcement learning (RL) combined with graph neural networks (GNNs) has shown promising results in various symbolic planning domains described by PDDL. However, existing approaches typically represent planning states as fully connected graphs, leading to a combinatorial explosion in edge information and substantial sparsity as problem scales grow, especially evident in large grid-based environments. This dense representation results in diluted node-level information, exponentially increases memory requirements, and ultimately makes learning infeasible for larger-scale problems. To address these challenges, we propose a sparse, goal-aware GNN representation that selectively encodes relevant local relationships and explicitly integrates spatial features related to the goal. We validate our approach by designing novel drone mission scenarios based on PDDL within a grid world, effectively simulating realistic mission execution environments. Our experimental results demonstrate that our method scales effectively to larger grid sizes previously infeasible with dense graph representations and substantially improves policy generalization and success rates. Our findings provide a practical foundation for addressing realistic, large-scale generalized planning tasks.