Automated Play-Testing Through RL Based Human-Like Play-Styles Generation
This addresses the need for efficient and realistic automated play-testing in video game production, though it appears incremental as it builds on existing RL methods with a focus on data efficiency.
The paper tackles the problem of automating video game testing by generating human-like play-styles using reinforcement learning, resulting in CARMI, an agent that emulates player behaviors on unseen levels with minimal human data and training time.
The increasing complexity of gameplay mechanisms in modern video games is leading to the emergence of a wider range of ways to play games. The variety of possible play-styles needs to be anticipated by designers, through automated tests. Reinforcement Learning is a promising answer to the need of automating video game testing. To that effect one needs to train an agent to play the game, while ensuring this agent will generate the same play-styles as the players in order to give meaningful feedback to the designers. We present CARMI: a Configurable Agent with Relative Metrics as Input. An agent able to emulate the players play-styles, even on previously unseen levels. Unlike current methods it does not rely on having full trajectories, but only summary data. Moreover it only requires little human data, thus compatible with the constraints of modern video game production. This novel agent could be used to investigate behaviors and balancing during the production of a video game with a realistic amount of training time.