Vulnerability of Natural Language Classifiers to Evolutionary Generated Adversarial Text
For NLP security, GAversary provides a strong black-box attack method with high effectiveness, though it is incremental over existing GA-based approaches.
GAversary, a hybrid Genetic Algorithm using GloVe embeddings, generates black-box adversarial attacks on NLP classifiers, reducing accuracy from 76.8% to 5.8% (vs. BAE's 27.6%) at the cost of more word perturbations and slightly lower semantic similarity.
Deep learning models have achieved impressive performance across various fields but remain vulnerable to adversarial inputs, particularly in NLP, where such attacks can have significant real-world consequences. Adversarial attacks often involve small, semantically similar token replacements to fool NLP models, and recent methods have become more precise by targeting specific vulnerable words, often by exploiting some level of access to the model's internal structure. This paper proposes GAversary, a hybrid Genetic Algorithm (GA) to generate adversarial attacks on natural language models. The GA is able to treat the target model as a black box, requiring only the logit value output by the model to guide the search. GAversary differs from GAs previously proposed for this problem by using GloVe embeddings to propose word replacements (the mutation operator) to improve the semantic similarity of the adversarial examples. GAversary is applied to several benchmark data sets and well-known target models. GAversary is able to substantially reduce the target model's accuracy on test data compared to the BAE and A2T attacks compared against (in the best case, reducing a 76.8% accuracy to 5.8%, compared to BAE's 27.6%). The trade-off is that GAversary perturbs just under twice as many words as the other two methods, with a slightly lower semantic similarity to the original text and around a 5% increase in run-time.