CVMay 28, 2019

Cross-Domain Transferability of Adversarial Perturbations

arXiv:1905.11736v5183 citations
Originality Highly original
AI Analysis

This work addresses a critical security concern for deep neural networks in real-world applications by enabling highly transferable attacks across domains, representing a significant advance rather than an incremental improvement.

The paper tackles the problem of adversarial example transferability across different domains, demonstrating that domain-invariant adversaries can be crafted to fool models trained on wholly different datasets, achieving success rates as high as ~99% on ImageNet samples. This result sets a new state-of-the-art for fooling rates in both white-box and black-box scenarios.

Adversarial examples reveal the blind spots of deep neural networks (DNNs) and represent a major concern for security-critical applications. The transferability of adversarial examples makes real-world attacks possible in black-box settings, where the attacker is forbidden to access the internal parameters of the model. The underlying assumption in most adversary generation methods, whether learning an instance-specific or an instance-agnostic perturbation, is the direct or indirect reliance on the original domain-specific data distribution. In this work, for the first time, we demonstrate the existence of domain-invariant adversaries, thereby showing common adversarial space among different datasets and models. To this end, we propose a framework capable of launching highly transferable attacks that crafts adversarial patterns to mislead networks trained on wholly different domains. For instance, an adversarial function learned on Paintings, Cartoons or Medical images can successfully perturb ImageNet samples to fool the classifier, with success rates as high as $\sim$99\% ($\ell_{\infty} \le 10$). The core of our proposed adversarial function is a generative network that is trained using a relativistic supervisory signal that enables domain-invariant perturbations. Our approach sets the new state-of-the-art for fooling rates, both under the white-box and black-box scenarios. Furthermore, despite being an instance-agnostic perturbation function, our attack outperforms the conventionally much stronger instance-specific attack methods.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes