LGCRMLJun 18, 2019

Poisoning Attacks with Generative Adversarial Nets

arXiv:1906.07773v269 citations
AI Analysis

This addresses the vulnerability of machine learning algorithms to poisoning attacks, offering a method to evaluate and potentially exploit weaknesses in classifiers, though it is incremental in improving attack techniques.

The paper tackles the problem of crafting systematic poisoning attacks against machine learning classifiers by introducing a novel generative model that produces adversarial training examples, which degrade classifier accuracy when used for training. The experimental results demonstrate the attack's effectiveness in compromising classifiers, including deep networks.

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have already been proposed to evaluate worst-case scenarios, modelling attacks as a bi-level optimization problem. Solving these problems is computationally demanding and has limited applicability for some models such as deep networks. In this paper we introduce a novel generative model to craft systematic poisoning attacks against machine learning classifiers generating adversarial training examples, i.e. samples that look like genuine data points but that degrade the classifier's accuracy when used for training. We propose a Generative Adversarial Net with three components: generator, discriminator, and the target classifier. This approach allows us to model naturally the detectability constrains that can be expected in realistic attacks and to identify the regions of the underlying data distribution that can be more vulnerable to data poisoning. Our experimental evaluation shows the effectiveness of our attack to compromise machine learning classifiers, including deep networks.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes