Kolmogorov-Smirnov GAN
This is an incremental improvement for researchers in generative modeling, offering a more stable training alternative.
The paper tackles the problem of training deep generative models by proposing KSGAN, which minimizes the Kolmogorov-Smirnov distance for improved stability and robustness, achieving performance comparable to existing adversarial methods with resistance to mode dropping and hyperparameter sensitivity.
We propose a novel deep generative model, the Kolmogorov-Smirnov Generative Adversarial Network (KSGAN). Unlike existing approaches, KSGAN formulates the learning process as a minimization of the Kolmogorov-Smirnov (KS) distance, generalized to handle multivariate distributions. This distance is calculated using the quantile function, which acts as the critic in the adversarial training process. We formally demonstrate that minimizing the KS distance leads to the trained approximate distribution aligning with the target distribution. We propose an efficient implementation and evaluate its effectiveness through experiments. The results show that KSGAN performs on par with existing adversarial methods, exhibiting stability during training, resistance to mode dropping and collapse, and tolerance to variations in hyperparameter settings. Additionally, we review the literature on the Generalized KS test and discuss the connections between KSGAN and existing adversarial generative models.