Turn-based Multi-Agent Reinforcement Learning Model Checking
This addresses verification challenges for TMARL agents in complex games, though it appears incremental as it builds on existing model checking techniques.
The paper tackles the problem of verifying turn-based multi-agent reinforcement learning agents in stochastic multiplayer games, proposing a method that integrates TMARL with model checking to improve scalability, with experiments showing it scales better than naive monolithic model checking.
In this paper, we propose a novel approach for verifying the compliance of turn-based multi-agent reinforcement learning (TMARL) agents with complex requirements in stochastic multiplayer games. Our method overcomes the limitations of existing verification approaches, which are inadequate for dealing with TMARL agents and not scalable to large games with multiple agents. Our approach relies on tight integration of TMARL and a verification technique referred to as model checking. We demonstrate the effectiveness and scalability of our technique through experiments in different types of environments. Our experiments show that our method is suited to verify TMARL agents and scales better than naive monolithic model checking.