Individual Control Barrier Functions-Guided Diffusion Model for Safe Offline Multi-Agent Reinforcement Learning
It addresses the underexplored safety challenges in offline multi-agent reinforcement learning, which is crucial for safety-critical applications.
The paper proposes a safe offline multi-agent reinforcement learning algorithm that integrates neural individual control barrier functions into a diffusion model to improve safety in trajectory generation, achieving substantial safety improvements while maintaining competitive rewards across diverse benchmarks.
Offline reinforcement learning allows control policies to be learned directly from data without online interaction, making it suitable for safety-critical tasks. Recent studies have applied diffusion models to offline reinforcement learning to leverage their strong capacity for modeling complex data distributions. However, existing approaches primarily focus on single-agent settings, leaving the safety challenges in multi-agent environments largely unexplored. In this work, we propose a safe offline multi-agent reinforcement learning algorithm that embeds neural individual control barrier functions into the diffusion model to enhance safety during trajectory generation, with control policies recovered through inverse dynamics. We evaluate our algorithm across diverse benchmarks, demonstrating substantial safety improvements while maintaining competitive rewards.