CVJul 22, 2024

TextureCrop: Enhancing Synthetic Image Detection through Texture-based Cropping

arXiv:2407.15500v410 citationsh-index: 15Has Code
Originality Incremental advance
AI Analysis

This addresses the need for more effective detection of AI-generated images to combat misuse, though it is incremental as it builds on existing SID methods.

The paper tackles the problem of synthetic image detection by proposing TextureCrop, a texture-based cropping pre-processing component that enhances detection performance, achieving a 6.1% improvement in AUC over center cropping and 15% over resizing on high-resolution datasets.

Generative AI technologies produce increasingly realistic imagery, which, despite its potential for creative applications, can also be misused to produce misleading and harmful content. This renders Synthetic Image Detection (SID) methods essential for identifying AI-generated content online. State-of-the-art SID methods typically resize or center-crop input images due to architectural or computational constraints, which hampers the detection of artifacts that appear in high-resolution images. To address this limitation, we propose TextureCrop, an image pre-processing component that can be plugged in any pre-trained SID model to improve its performance. By focusing on high-frequency image parts where generative artifacts are prevalent, TextureCrop enhances SID performance with manageable memory requirements. Experimental results demonstrate a consistent improvement in AUC across various detectors by 6.1% compared to center cropping and by 15% compared to resizing, across high-resolution images from the Forensynths, Synthbuster and TWIGMA datasets. Code available at https : //github.com/mever-team/texture-crop.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes