Towards Principled Methods for Training Generative Adversarial Networks
This work addresses fundamental training challenges in GANs for researchers and practitioners, offering a principled approach to improve model stability.
The paper tackles the instability and saturation issues in training generative adversarial networks (GANs) by providing a theoretical analysis and proving these problems rigorously, with targeted experiments to verify assumptions and quantify phenomena.
The goal of this paper is not to introduce a single algorithm or method, but to make theoretical steps towards fully understanding the training dynamics of generative adversarial networks. In order to substantiate our theoretical analysis, we perform targeted experiments to verify our assumptions, illustrate our claims, and quantify the phenomena. This paper is divided into three sections. The first section introduces the problem at hand. The second section is dedicated to studying and proving rigorously the problems including instability and saturation that arize when training generative adversarial networks. The third section examines a practical and theoretically grounded direction towards solving these problems, while introducing new tools to study them.