LGMLFeb 21, 2020

Adversarial Detection and Correction by Matching Prediction Distributions

arXiv:2002.09364v122 citations
AI Analysis

This addresses the problem of adversarial vulnerability in ML classifiers for security-critical applications, offering a flexible defense that also handles data corruptions, though it appears incremental in its approach.

The paper tackles adversarial attacks on machine learning classifiers by introducing an unsupervised detection and correction method that neutralizes powerful attacks like Carlini-Wagner or SLIDE on datasets such as MNIST and Fashion-MNIST, and remains effective on CIFAR-10 under various attack scenarios.

We present a novel adversarial detection and correction method for machine learning classifiers.The detector consists of an autoencoder trained with a custom loss function based on the Kullback-Leibler divergence between the classifier predictions on the original and reconstructed instances.The method is unsupervised, easy to train and does not require any knowledge about the underlying attack. The detector almost completely neutralises powerful attacks like Carlini-Wagner or SLIDE on MNIST and Fashion-MNIST, and remains very effective on CIFAR-10 when the attack is granted full access to the classification model but not the defence. We show that our method is still able to detect the adversarial examples in the case of a white-box attack where the attacker has full knowledge of both the model and the defence and investigate the robustness of the attack. The method is very flexible and can also be used to detect common data corruptions and perturbations which negatively impact the model performance. We illustrate this capability on the CIFAR-10-C dataset.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes