LGCRMLOct 16, 2019

A New Defense Against Adversarial Images: Turning a Weakness into a Strength

arXiv:1910.07629v2112 citations
Originality Highly original
AI Analysis

This addresses the challenge of robust adversarial detection for machine learning security, offering a novel approach that is not easily bypassed by adaptive adversaries.

The paper tackles the problem of detecting adversarial attacks on images by proposing a new perspective that treats the omnipresence of adversarial perturbations as a strength, leading to a detection method that achieves unprecedented accuracy in white-box settings.

Natural images are virtually surrounded by low-density misclassified regions that can be efficiently discovered by gradient-guided search --- enabling the generation of adversarial images. While many techniques for detecting these attacks have been proposed, they are easily bypassed when the adversary has full knowledge of the detection mechanism and adapts the attack strategy accordingly. In this paper, we adopt a novel perspective and regard the omnipresence of adversarial perturbations as a strength rather than a weakness. We postulate that if an image has been tampered with, these adversarial directions either become harder to find with gradient methods or have substantially higher density than for natural images. We develop a practical test for this signature characteristic to successfully detect adversarial attacks, achieving unprecedented accuracy under the white-box setting where the adversary is given full knowledge of our detection mechanism.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes