Meta Arcade: A Configurable Environment Suite for Meta-Learning
This provides a configurable benchmark for researchers studying knowledge transfer in multi-task and meta-learning, though it is incremental as it builds on existing environment suites.
The authors tackled the lack of configurable environment suites for meta-learning in deep reinforcement learning by developing Meta Arcade, a tool that enables easy creation of custom 2D arcade games with shared elements, resulting in a suite of 24 predefined games and demonstrations of applications like transfer learning.
Most approaches to deep reinforcement learning (DRL) attempt to solve a single task at a time. As a result, most existing research benchmarks consist of individual games or suites of games that have common interfaces but little overlap in their perceptual features, objectives, or reward structures. To facilitate research into knowledge transfer among trained agents (e.g. via multi-task and meta-learning), more environment suites that provide configurable tasks with enough commonality to be studied collectively are needed. In this paper we present Meta Arcade, a tool to easily define and configure custom 2D arcade games that share common visuals, state spaces, action spaces, game components, and scoring mechanisms. Meta Arcade differs from prior environments in that both task commonality and configurability are prioritized: entire sets of games can be constructed from common elements, and these elements are adjustable through exposed parameters. We include a suite of 24 predefined games that collectively illustrate the possibilities of this framework and discuss how these games can be configured for research applications. We provide several experiments that illustrate how Meta Arcade could be used, including single-task benchmarks of predefined games, sample curriculum-based approaches that change game parameters over a set schedule, and an exploration of transfer learning between games.