LGCLCRJun 1, 2024

Exploring Vulnerabilities and Protections in Large Language Models: A Survey

arXiv:2406.00240v114 citations
Originality Synthesis-oriented
AI Analysis

It addresses security risks for AI applications using LLMs, but is incremental as it synthesizes existing knowledge without new empirical results.

This survey examines security vulnerabilities in Large Language Models, focusing on prompt hacking and adversarial attacks, and discusses defense mechanisms to protect against these threats.

As Large Language Models (LLMs) increasingly become key components in various AI applications, understanding their security vulnerabilities and the effectiveness of defense mechanisms is crucial. This survey examines the security challenges of LLMs, focusing on two main areas: Prompt Hacking and Adversarial Attacks, each with specific types of threats. Under Prompt Hacking, we explore Prompt Injection and Jailbreaking Attacks, discussing how they work, their potential impacts, and ways to mitigate them. Similarly, we analyze Adversarial Attacks, breaking them down into Data Poisoning Attacks and Backdoor Attacks. This structured examination helps us understand the relationships between these vulnerabilities and the defense strategies that can be implemented. The survey highlights these security challenges and discusses robust defensive frameworks to protect LLMs against these threats. By detailing these security issues, the survey contributes to the broader discussion on creating resilient AI systems that can resist sophisticated attacks.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes