The Procedural Content Generation Benchmark: An Open-source Testbed for Generative Challenges in Games
This provides a standardized benchmark for comparing generative algorithms in game content creation, though it is incremental as it builds on existing methods.
The paper introduces the Procedural Content Generation Benchmark, an open-source testbed with 12 game-related tasks to evaluate generative algorithms, and results show varying problem difficulty and the impact of objectives on quality, diversity, and controllability.
This paper introduces the Procedural Content Generation Benchmark for evaluating generative algorithms on different game content creation tasks. The benchmark comes with 12 game-related problems with multiple variants on each problem. Problems vary from creating levels of different kinds to creating rule sets for simple arcade games. Each problem has its own content representation, control parameters, and evaluation metrics for quality, diversity, and controllability. This benchmark is intended as a first step towards a standardized way of comparing generative algorithms. We use the benchmark to score three baseline algorithms: a random generator, an evolution strategy, and a genetic algorithm. Results show that some problems are easier to solve than others, as well as the impact the chosen objective has on quality, diversity, and controllability of the generated artifacts.