LGMLJul 23, 2020

Provably Robust Adversarial Examples

arXiv:2007.12133v312 citations
AI Analysis

This addresses the challenge of creating reliable adversarial examples for testing and improving deep neural network defenses, particularly against state-of-the-art methods like randomized smoothing, with incremental advancements in certification techniques.

The paper tackles the problem of generating adversarial examples that are provably robust to real-world perturbations like pixel intensity changes and geometric transformations, introducing a method called PARADE that successfully finds large provably robust regions containing up to approximately 10^599 adversarial examples.

We introduce the concept of provably robust adversarial examples for deep neural networks - connected input regions constructed from standard adversarial examples which are guaranteed to be robust to a set of real-world perturbations (such as changes in pixel intensity and geometric transformations). We present a novel method called PARADE for generating these regions in a scalable manner which works by iteratively refining the region initially obtained via sampling until a refined region is certified to be adversarial with existing state-of-the-art verifiers. At each step, a novel optimization procedure is applied to maximize the region's volume under the constraint that the convex relaxation of the network behavior with respect to the region implies a chosen bound on the certification objective. Our experimental evaluation shows the effectiveness of PARADE: it successfully finds large provably robust regions including ones containing $\approx 10^{573}$ adversarial examples for pixel intensity and $\approx 10^{599}$ for geometric perturbations. The provability enables our robust examples to be significantly more effective against state-of-the-art defenses based on randomized smoothing than the individual attacks used to construct the regions.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes