Advancing NLP Security by Leveraging LLMs as Adversarial Engines
It addresses security for NLP systems in critical domains, but is incremental as it builds on existing work on word-level attacks.
This position paper proposes using Large Language Models (LLMs) to generate diverse adversarial attacks for NLP security, aiming to enhance model robustness and uncover vulnerabilities in critical applications.
This position paper proposes a novel approach to advancing NLP security by leveraging Large Language Models (LLMs) as engines for generating diverse adversarial attacks. Building upon recent work demonstrating LLMs' effectiveness in creating word-level adversarial examples, we argue for expanding this concept to encompass a broader range of attack types, including adversarial patches, universal perturbations, and targeted attacks. We posit that LLMs' sophisticated language understanding and generation capabilities can produce more effective, semantically coherent, and human-like adversarial examples across various domains and classifier architectures. This paradigm shift in adversarial NLP has far-reaching implications, potentially enhancing model robustness, uncovering new vulnerabilities, and driving innovation in defense mechanisms. By exploring this new frontier, we aim to contribute to the development of more secure, reliable, and trustworthy NLP systems for critical applications.