CVJul 5, 2020

Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networks

arXiv:2007.02343v2601 citations
AI Analysis

This addresses the issue of detectability in backdoor attacks for computer vision security, representing a novel approach rather than an incremental improvement.

The paper tackles the problem of stealth in backdoor attacks on deep neural networks by introducing a new attack inspired by natural reflections, achieving high success rates on state-of-the-art models and resistance to defenses across multiple datasets.

Recent studies have shown that DNNs can be compromised by backdoor attacks crafted at training time. A backdoor attack installs a backdoor into the victim model by injecting a backdoor pattern into a small proportion of the training data. At test time, the victim model behaves normally on clean test data, yet consistently predicts a specific (likely incorrect) target class whenever the backdoor pattern is present in a test example. While existing backdoor attacks are effective, they are not stealthy. The modifications made on training data or labels are often suspicious and can be easily detected by simple data filtering or human inspection. In this paper, we present a new type of backdoor attack inspired by an important natural phenomenon: reflection. Using mathematical modeling of physical reflection models, we propose reflection backdoor (Refool) to plant reflections as backdoor into a victim model. We demonstrate on 3 computer vision tasks and 5 datasets that, Refool can attack state-of-the-art DNNs with high success rate, and is resistant to state-of-the-art backdoor defenses.

Code Implementations3 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes