Unmasking Facial DeepFakes: A Robust Multiview Detection Framework for Natural Images
This addresses the challenge of robust DeepFake detection for security and media verification, though it appears incremental as it builds on existing multi-view or feature analysis methods.
The paper tackles the problem of detecting DeepFake face images under real-world conditions like pose variations and occlusions, proposing a multi-view detection framework that integrates specialized encoders for global, middle, and local features, achieving superior performance with experimental results showing it outperforms conventional single-view approaches.
DeepFake technology has advanced significantly in recent years, enabling the creation of highly realistic synthetic face images. Existing DeepFake detection methods often struggle with pose variations, occlusions, and artifacts that are difficult to detect in real-world conditions. To address these challenges, we propose a multi-view architecture that enhances DeepFake detection by analyzing facial features at multiple levels. Our approach integrates three specialized encoders, a global view encoder for detecting boundary inconsistencies, a middle view encoder for analyzing texture and color alignment, and a local view encoder for capturing distortions in expressive facial regions such as the eyes, nose, and mouth, where DeepFake artifacts frequently occur. Additionally, we incorporate a face orientation encoder, trained to classify face poses, ensuring robust detection across various viewing angles. By fusing features from these encoders, our model achieves superior performance in detecting manipulated images, even under challenging pose and lighting conditions.Experimental results on challenging datasets demonstrate the effectiveness of our method, outperforming conventional single-view approaches