CVMar 23

VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detection

arXiv:2603.2152686.61 citationsh-index: 3
AI Analysis

This addresses the problem of interpretable and generalizable deepfake detection for security and media verification applications, representing a novel method for a known bottleneck.

The paper tackles unreliable deepfake detection by multimodal large language models (MLLMs) by proposing VIGIL, a part-centric structured forensic framework that separates evidence generation and manipulation localization into distinct steps, resulting in consistent outperformance of expert detectors and MLLM-based methods across all generalizability levels in experiments.

Multimodal large language models (MLLMs) offer a promising path toward interpretable deepfake detection by generating textual explanations. However, the reasoning process of current MLLM-based methods combines evidence generation and manipulation localization into a unified step. This combination blurs the boundary between faithful observations and hallucinated explanations, leading to unreliable conclusions. Building on this, we present VIGIL, a part-centric structured forensic framework inspired by expert forensic practice through a plan-then-examine pipeline: the model first plans which facial parts warrant inspection based on global visual cues, then examines each part with independently sourced forensic evidence. A stage-gated injection mechanism delivers part-level forensic evidence only during examination, ensuring that part selection remains driven by the model's own perception rather than biased by external signals. We further propose a progressive three-stage training paradigm whose reinforcement learning stage employs part-aware rewards to enforce anatomical validity and evidence--conclusion coherence. To enable rigorous generalizability evaluation, we construct OmniFake, a hierarchical 5-Level benchmark where the model, trained on only three foundational generators, is progressively tested up to in-the-wild social-media data. Extensive experiments on OmniFake and cross-dataset evaluations demonstrate that VIGIL consistently outperforms both expert detectors and concurrent MLLM-based methods across all generalizability levels.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes