CVDec 5, 2023

Diffusion Noise Feature: Accurate and Fast Generated Image Detection

arXiv:2312.02625v328 citationsh-index: 1Has CodeECAI
Originality Highly original
AI Analysis

This addresses the critical challenge of misinformation spread through realistic generated images, offering a robust detection method for security and verification applications.

The paper tackles the problem of detecting AI-generated images by proposing Diffusion Noise Feature (DNF), a novel representation derived from diffusion models that amplifies high-frequency artifacts, achieving state-of-the-art accuracy and generalization across multiple datasets.

Generative models now produce images with such stunning realism that they can easily deceive the human eye. While this progress unlocks vast creative potential, it also presents significant risks, such as the spread of misinformation. Consequently, detecting generated images has become a critical research challenge. However, current detection methods are often plagued by low accuracy and poor generalization. In this paper, to address these limitations and enhance the detection of generated images, we propose a novel representation, Diffusion Noise Feature (DNF). Derived from the inverse process of diffusion models, DNF effectively amplifies the subtle, high-frequency artifacts that act as fingerprints of artificial generation. Our key insight is that real and generated images exhibit distinct DNF signatures, providing a robust basis for differentiation. By training a simple classifier such as ResNet-50 on DNF, our approach achieves remarkable accuracy, robustness, and generalization in detecting generated images, including those from unseen generators or with novel content. Extensive experiments across four training datasets and five test sets confirm that DNF establishes a new state-of-the-art in generated image detection. The code is available at https://github.com/YichiCS/Diffusion-Noise-Feature.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes