CRAICLLGFeb 5, 2024

Adversarial Text Purification: A Large Language Model Approach for Defense

arXiv:2402.06655v110 citationsh-index: 14PAKDD
Originality Highly original
AI Analysis

This addresses the challenge of adversarial text purification, which has been relatively unexplored due to discrete noise perturbations, offering a defense mechanism for text classifiers without needing to know attack types or retrain classifiers.

The paper tackles the problem of defending text classifiers against adversarial attacks by proposing a novel adversarial text purification method using Large Language Models (LLMs), which improves classifier accuracy under attack by over 65% on average.

Adversarial purification is a defense mechanism for safeguarding classifiers against adversarial attacks without knowing the type of attacks or training of the classifier. These techniques characterize and eliminate adversarial perturbations from the attacked inputs, aiming to restore purified samples that retain similarity to the initially attacked ones and are correctly classified by the classifier. Due to the inherent challenges associated with characterizing noise perturbations for discrete inputs, adversarial text purification has been relatively unexplored. In this paper, we investigate the effectiveness of adversarial purification methods in defending text classifiers. We propose a novel adversarial text purification that harnesses the generative capabilities of Large Language Models (LLMs) to purify adversarial text without the need to explicitly characterize the discrete noise perturbations. We utilize prompt engineering to exploit LLMs for recovering the purified examples for given adversarial examples such that they are semantically similar and correctly classified. Our proposed method demonstrates remarkable performance over various classifiers, improving their accuracy under the attack by over 65% on average.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes