CRAILGMay 24

Furina: Fragmented Uncertainty-Driven Refusal Instability Attack

arXiv:2605.2615898.4Has Code
AI Analysis

For LLM safety researchers, it identifies a fundamental vulnerability in safety alignment mechanisms, explaining why detection-based defenses fail against sophisticated attacks.

The paper reveals that safety alignment in LLMs/MLLMs has an instability region where small perturbations cause stochastic refusal decisions, and introduces Furina, a jailbreak attack exploiting this via fragmented prompts, outperforming baselines on HarmBench and achieving competitive results on MM-SafetyBench.

Safety alignment in large language models (LLMs) and multimodal large language models (MLLMs) is commonly assumed to operate as a near-binary threshold mechanism. We challenge this assumption by revealing that safety behavior is governed by an instability region where small perturbations induce stochastic refusal decisions rather than deterministic outcomes. We develop a multi-metric diagnostic framework combining external and internal signals to characterize this instability. Through systematic experiments, we identify a characteristic diagnostic signature: inputs in unstable regimes exhibit elevated output uncertainty yet decreased internal safety activation, a decoupling phenomenon that explains why detection-based defenses fail against sophisticated attacks. Building on this framework, we introduce Furina, a jailbreak attack that deliberately induces this signature through fragmented, scene-anchored prompts without model-specific optimization. Furina outperforms strong single-turn and multi-turn baselines on HarmBench and achieves competitive results on MM-SafetyBench, demonstrating that uncertainty amplification provides a principled and transferable mechanism for understanding safety vulnerabilities. Code is available at: https://github.com/0xCavaliers/Furina_Jailbreak.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes