CVMar 28, 2024

Imperceptible Protection against Style Imitation from Diffusion Models

arXiv:2403.19254v311 citationsh-index: 11IEEE transactions on multimedia
Originality Incremental advance
AI Analysis

This addresses copyright infringement concerns for artists and creators, offering an incremental improvement over prior adversarial perturbation methods.

The paper tackles the problem of protecting artworks from style imitation by diffusion models while maintaining visual quality, achieving a method that substantially improves image quality without compromising protection efficacy.

Recent progress in diffusion models has profoundly enhanced the fidelity of image generation, but it has raised concerns about copyright infringements. While prior methods have introduced adversarial perturbations to prevent style imitation, most are accompanied by the degradation of artworks' visual quality. Recognizing the importance of maintaining this, we introduce a visually improved protection method while preserving its protection capability. To this end, we devise a perceptual map to highlight areas sensitive to human eyes, guided by instance-aware refinement, which refines the protection intensity accordingly. We also introduce a difficulty-aware protection by predicting how difficult the artwork is to protect and dynamically adjusting the intensity based on this. Lastly, we integrate a perceptual constraints bank to further improve the imperceptibility. Results show that our method substantially elevates the quality of the protected image without compromising on protection efficacy.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes