Collaborative Task and Path Planning for Heterogeneous Robotic Teams using Multi-Agent PPO
This addresses the challenge of efficient real-time planning for robotic teams in planetary exploration, though it is incremental as it applies an existing method to a specific domain.
The paper tackles the problem of coordinating heterogeneous robotic teams for extraterrestrial exploration by developing a collaborative planning strategy using Multi-Agent Proximal Policy Optimization (MAPPO), benchmarking it against optimal solutions and demonstrating online replanning capabilities.
Efficient robotic extraterrestrial exploration requires robots with diverse capabilities, ranging from scientific measurement tools to advanced locomotion. A robotic team enables the distribution of tasks over multiple specialized subsystems, each providing specific expertise to complete the mission. The central challenge lies in efficiently coordinating the team to maximize utilization and the extraction of scientific value. Classical planning algorithms scale poorly with problem size, leading to long planning cycles and high inference costs due to the combinatorial growth of possible robot-target allocations and possible trajectories. Learning-based methods are a viable alternative that move the scaling concern from runtime to training time, setting a critical step towards achieving real-time planning. In this work, we present a collaborative planning strategy based on Multi-Agent Proximal Policy Optimization (MAPPO) to coordinate a team of heterogeneous robots to solve a complex target allocation and scheduling problem. We benchmark our approach against single-objective optimal solutions obtained through exhaustive search and evaluate its ability to perform online replanning in the context of a planetary exploration scenario.