The Text-Based Adventure AI Competition
This addresses a gap in game AI competitions for researchers and developers, but it is incremental as it builds on existing competition frameworks.
The authors tackled the lack of AI competitions for text-based adventure games by running competitions from 2016 to 2018, providing a novel benchmark for game AI with challenges in natural language understanding and generation, and they presented results from an improved evaluation across 20 games.
In 2016, 2017, and 2018 at the IEEE Conference on Computational Intelligence in Games, the authors of this paper ran a competition for agents that can play classic text-based adventure games. This competition fills a gap in existing game AI competitions that have typically focussed on traditional card/board games or modern video games with graphical interfaces. By providing a platform for evaluating agents in text-based adventures, the competition provides a novel benchmark for game AI with unique challenges for natural language understanding and generation. This paper summarises the three competitions ran in 2016, 2017, and 2018 (including details of open source implementations of both the competition framework and our competitors) and presents the results of an improved evaluation of these competitors across 20 games.