CVLGMay 11, 2022

A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentials

ETH Zurich
arXiv:2205.05467v379 citationsh-index: 191Has Code
Originality Synthesis-oriented
AI Analysis

This addresses the need for robust deepfake detection in dynamic environments, but it is incremental as it adapts existing continual learning methods to a new dataset.

The paper tackles the problem of detecting deepfakes that appear incrementally in real-world scenarios by proposing a continual deepfake detection benchmark (CDDB) with evaluations on easy, hard, and long sequence tasks, and finds it more challenging than existing benchmarks.

There have been emerging a number of benchmarks and techniques for the detection of deepfakes. However, very few works study the detection of incrementally appearing deepfakes in the real-world scenarios. To simulate the wild scenes, this paper suggests a continual deepfake detection benchmark (CDDB) over a new collection of deepfakes from both known and unknown generative models. The suggested CDDB designs multiple evaluations on the detection over easy, hard, and long sequence of deepfake tasks, with a set of appropriate measures. In addition, we exploit multiple approaches to adapt multiclass incremental learning methods, commonly used in the continual visual recognition, to the continual deepfake detection problem. We evaluate existing methods, including their adapted ones, on the proposed CDDB. Within the proposed benchmark, we explore some commonly known essentials of standard continual learning. Our study provides new insights on these essentials in the context of continual deepfake detection. The suggested CDDB is clearly more challenging than the existing benchmarks, which thus offers a suitable evaluation avenue to the future research. Both data and code are available at https://github.com/Coral79/CDDB.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes