CVCRNov 22, 2023

Steal My Artworks for Fine-tuning? A Watermarking Framework for Detecting Art Theft Mimicry in Text-to-Image Models

arXiv:2311.13619v113 citationsh-index: 38
Originality Incremental advance
AI Analysis

This addresses copyright infringement for artists whose styles are mimicked for profit, though it is incremental as it builds on existing watermarking techniques for a new application.

The paper tackles the problem of unauthorized fine-tuning of text-to-image models using artists' copyrighted artworks by proposing a watermarking framework that embeds subtle watermarks into digital artworks to detect mimicry, with research confirming reliable detection in various scenarios and against attacks.

The advancement in text-to-image models has led to astonishing artistic performances. However, several studios and websites illegally fine-tune these models using artists' artworks to mimic their styles for profit, which violates the copyrights of artists and diminishes their motivation to produce original works. Currently, there is a notable lack of research focusing on this issue. In this paper, we propose a novel watermarking framework that detects mimicry in text-to-image models through fine-tuning. This framework embeds subtle watermarks into digital artworks to protect their copyrights while still preserving the artist's visual expression. If someone takes watermarked artworks as training data to mimic an artist's style, these watermarks can serve as detectable indicators. By analyzing the distribution of these watermarks in a series of generated images, acts of fine-tuning mimicry using stolen victim data will be exposed. In various fine-tune scenarios and against watermark attack methods, our research confirms that analyzing the distribution of watermarks in artificially generated images reliably detects unauthorized mimicry.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes