Game-Theoretic Multiagent Reinforcement Learning
This work addresses the need for an updated survey in the interdisciplinary field of MARL, which is incremental as it synthesizes existing knowledge rather than introducing new methods.
The authors tackled the lack of a comprehensive and up-to-date overview of multiagent reinforcement learning (MARL) by providing a monograph that covers both fundamentals and recent developments from a game-theoretic perspective, aiming to serve as a resource for new and expert researchers.
Tremendous advances have been made in multiagent reinforcement learning (MARL). MARL corresponds to the learning problem in a multiagent system in which multiple agents learn simultaneously. It is an interdisciplinary field of study with a long history that includes game theory, machine learning, stochastic control, psychology, and optimization. Despite great successes in MARL, there is a lack of a self-contained overview of the literature that covers game-theoretic foundations of modern MARL methods and summarizes the recent advances. The majority of existing surveys are outdated and do not fully cover the recent developments since 2010. In this work, we provide a monograph on MARL that covers both the fundamentals and the latest developments on the research frontier. The goal of this monograph is to provide a self-contained assessment of the current state-of-the-art MARL techniques from a game-theoretic perspective. We expect this work to serve as a stepping stone for both new researchers who are about to enter this fast-growing field and experts in the field who want to obtain a panoramic view and identify new directions based on recent advances.