A General Retraining Framework for Scalable Adversarial Classification
This addresses the vulnerability of classification systems to adversarial attacks, offering a scalable solution for improving security in machine learning applications.
The paper tackles the problem of adversarial evasion attacks in classification by proposing a general-purpose retraining framework that boosts robustness for arbitrary learning algorithms against a broad class of adversarial models, showing it significantly enhances robustness without compromising accuracy.
Traditional classification algorithms assume that training and test data come from similar distributions. This assumption is violated in adversarial settings, where malicious actors modify instances to evade detection. A number of custom methods have been developed for both adversarial evasion attacks and robust learning. We propose the first systematic and general-purpose retraining framework which can: a) boost robustness of an \emph{arbitrary} learning algorithm, in the face of b) a broader class of adversarial models than any prior methods. We show that, under natural conditions, the retraining framework minimizes an upper bound on optimal adversarial risk, and show how to extend this result to account for approximations of evasion attacks. Extensive experimental evaluation demonstrates that our retraining methods are nearly indistinguishable from state-of-the-art algorithms for optimizing adversarial risk, but are more general and far more scalable. The experiments also confirm that without retraining, our adversarial framework dramatically reduces the effectiveness of learning. In contrast, retraining significantly boosts robustness to evasion attacks without significantly compromising overall accuracy.