CVAICRLGFeb 9, 2023

Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples

arXiv:2302.04578v2205 citationsh-index: 39Has Code
AI Analysis

This addresses copyright concerns for human artists against infringers using diffusion models, presenting a novel application of adversarial examples in this domain.

The paper tackles the problem of copyright infringement in AI-generated art by using adversarial examples to prevent diffusion models from imitating unauthorized painting styles, showing that their method effectively hinders feature extraction in experiments.

Recently, Diffusion Models (DMs) boost a wave in AI for Art yet raise new copyright concerns, where infringers benefit from using unauthorized paintings to train DMs to generate novel paintings in a similar style. To address these emerging copyright violations, in this paper, we are the first to explore and propose to utilize adversarial examples for DMs to protect human-created artworks. Specifically, we first build a theoretical framework to define and evaluate the adversarial examples for DMs. Then, based on this framework, we design a novel algorithm, named AdvDM, which exploits a Monte-Carlo estimation of adversarial examples for DMs by optimizing upon different latent variables sampled from the reverse process of DMs. Extensive experiments show that the generated adversarial examples can effectively hinder DMs from extracting their features. Therefore, our method can be a powerful tool for human artists to protect their copyright against infringers equipped with DM-based AI-for-Art applications. The code of our method is available on GitHub: https://github.com/mist-project/mist.git.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes