CVCLMar 14, 2024

Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking Multimodal Large Language Models

arXiv:2403.09792v3132 citationsHas CodeECCV
Originality Incremental advance
AI Analysis

This addresses a critical safety problem for users and developers of MLLMs by exposing alignment vulnerabilities, though it is incremental as it builds on known jailbreaking techniques.

The paper tackles the vulnerability of multimodal large language models (MLLMs) to harmful content through image inputs, proposing a jailbreak method called HADES that achieves an average Attack Success Rate of 90.26% for LLaVA-1.5 and 71.60% for Gemini Pro Vision.

In this paper, we study the harmlessness alignment problem of multimodal large language models (MLLMs). We conduct a systematic empirical analysis of the harmlessness performance of representative MLLMs and reveal that the image input poses the alignment vulnerability of MLLMs. Inspired by this, we propose a novel jailbreak method named HADES, which hides and amplifies the harmfulness of the malicious intent within the text input, using meticulously crafted images. Experimental results show that HADES can effectively jailbreak existing MLLMs, which achieves an average Attack Success Rate (ASR) of 90.26% for LLaVA-1.5 and 71.60% for Gemini Pro Vision. Our code and data are available at https://github.com/RUCAIBox/HADES.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes