Resisting Adversarial Attacks using Gaussian Mixture Variational Autoencoders
This work addresses the security challenge of adversarial attacks for machine learning systems, offering a novel approach to enhance model robustness.
The paper tackles the problem of deep neural networks' vulnerability to adversarial and fooling samples by proposing a unified framework using a Gaussian mixture variational autoencoder, which enables selective classification to reject adversarial samples and achieves improved robustness with concrete performance gains.
Susceptibility of deep neural networks to adversarial attacks poses a major theoretical and practical challenge. All efforts to harden classifiers against such attacks have seen limited success. Two distinct categories of samples to which deep networks are vulnerable, "adversarial samples" and "fooling samples", have been tackled separately so far due to the difficulty posed when considered together. In this work, we show how one can address them both under one unified framework. We tie a discriminative model with a generative model, rendering the adversarial objective to entail a conflict. Our model has the form of a variational autoencoder, with a Gaussian mixture prior on the latent vector. Each mixture component of the prior distribution corresponds to one of the classes in the data. This enables us to perform selective classification, leading to the rejection of adversarial samples instead of misclassification. Our method inherently provides a way of learning a selective classifier in a semi-supervised scenario as well, which can resist adversarial attacks. We also show how one can reclassify the rejected adversarial samples.