CVNov 15, 2019

Learning To Characterize Adversarial Subspaces

arXiv:1911.06587v113 citations
Originality Incremental advance
AI Analysis

This addresses the vulnerability of DNNs to adversarial attacks, offering improved detection for security applications, though it is an incremental advance over prior methods.

The paper tackles the problem of detecting adversarial examples in deep neural networks by proposing a method that learns metrics to characterize adversarial subspaces, achieving state-of-the-art results on CIFAR-10, CIFAR-100, and ImageNet datasets across multiple detection settings.

Deep Neural Networks (DNNs) are known to be vulnerable to the maliciously generated adversarial examples. To detect these adversarial examples, previous methods use artificially designed metrics to characterize the properties of \textit{adversarial subspaces} where adversarial examples lie. However, we find these methods are not working in practical attack detection scenarios. Because the artificially defined features are lack of robustness and show limitation in discriminative power to detect strong attacks. To solve this problem, we propose a novel adversarial detection method which identifies adversaries by adaptively learning reasonable metrics to characterize adversarial subspaces. As auxiliary context information, \textit{k} nearest neighbors are used to represent the surrounded subspace of the detected sample. We propose an innovative model called Neighbor Context Encoder (NCE) to learn from \textit{k} neighbors context and infer if the detected sample is normal or adversarial. We conduct thorough experiment on CIFAR-10, CIFAR-100 and ImageNet dataset. The results demonstrate that our approach surpasses all existing methods under three settings: \textit{attack-aware black-box detection}, \textit{attack-unaware black-box detection} and \textit{white-box detection}.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes