CVJul 19, 2022

Shrinking the Semantic Gap: Spatial Pooling of Local Moment Invariants for Copy-Move Forgery Detection

arXiv:2207.09135v230 citationsh-index: 24
Originality Incremental advance
AI Analysis

This work addresses a specific forensic challenge in digital image analysis, offering improvements for detecting manipulations in complex scenarios, but it appears incremental as it builds on existing methods with novel adaptations.

The paper tackles the problem of copy-move forgery detection in images with high self-similarity or corruption by addressing the semantic gap between low-level visual features and high-level concepts, using spatial pooling of local moment invariants for midlevel representation, and reports superior performance over state-of-the-art algorithms.

Copy-move forgery is a manipulation of copying and pasting specific patches from and to an image, with potentially illegal or unethical uses. Recent advances in the forensic methods for copy-move forgery have shown increasing success in detection accuracy and robustness. However, for images with high self-similarity or strong signal corruption, the existing algorithms often exhibit inefficient processes and unreliable results. This is mainly due to the inherent semantic gap between low-level visual representation and high-level semantic concept. In this paper, we present a very first study of trying to mitigate the semantic gap problem in copy-move forgery detection, with spatial pooling of local moment invariants for midlevel image representation. Our detection method expands the traditional works on two aspects: 1) we introduce the bag-of-visual-words model into this field for the first time, may meaning a new perspective of forensic study; 2) we propose a word-to-phrase feature description and matching pipeline, covering the spatial structure and visual saliency information of digital images. Extensive experimental results show the superior performance of our framework over state-of-the-art algorithms in overcoming the related problems caused by the semantic gap.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes