Mini Honor of Kings: A Lightweight Environment for Multi-Agent Reinforcement Learning
This provides a more accessible and challenging environment for MARL researchers, though it is incremental as it adapts an existing game for research purposes.
The authors tackled the challenges of limited customization, high computational demands, and oversimplification in multi-agent reinforcement learning (MARL) environments by introducing Mini Honor of Kings, a lightweight environment based on a popular mobile game, which allows experiments on personal PCs and demonstrates that common MARL algorithms have not found optimal solutions.
Games are widely used as research environments for multi-agent reinforcement learning (MARL), but they pose three significant challenges: limited customization, high computational demands, and oversimplification. To address these issues, we introduce the first publicly available map editor for the popular mobile game Honor of Kings and design a lightweight environment, Mini Honor of Kings (Mini HoK), for researchers to conduct experiments. Mini HoK is highly efficient, allowing experiments to be run on personal PCs or laptops while still presenting sufficient challenges for existing MARL algorithms. We have tested our environment on common MARL algorithms and demonstrated that these algorithms have yet to find optimal solutions within this environment. This facilitates the dissemination and advancement of MARL methods within the research community. Additionally, we hope that more researchers will leverage the Honor of Kings map editor to develop innovative and scientifically valuable new maps. Our code and user manual are available at: https://github.com/tencent-ailab/mini-hok.