Communication-Efficient Reinforcement Learning in Swarm Robotic Networks for Maze Exploration
This work addresses the challenge of efficient coordination in swarm robotic networks for applications like maze exploration, representing an incremental improvement over existing methods.
The paper tackled the problem of coordinating swarm robots for maze exploration by proposing a communication-efficient decentralized cooperative reinforcement learning algorithm, resulting in significantly higher coverage accuracy and efficiency while reducing costs and overlaps, even in high packet loss and low communication range scenarios.
Smooth coordination within a swarm robotic system is essential for the effective execution of collective robot missions. Having efficient communication is key to the successful coordination of swarm robots. This paper proposes a new communication-efficient decentralized cooperative reinforcement learning algorithm for coordinating swarm robots. It is made efficient by hierarchically building on the use of local information exchanges. We consider a case study application of maze solving through cooperation among a group of robots, where the time and costs are minimized while avoiding inter-robot collisions and path overlaps during exploration. With a solid theoretical basis, we extensively analyze the algorithm with realistic CORE network simulations and evaluate it against state-of-the-art solutions in terms of maze coverage percentage and efficiency under communication-degraded environments. The results demonstrate significantly higher coverage accuracy and efficiency while reducing costs and overlaps even in high packet loss and low communication range scenarios.