OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization
This addresses copyright protection and user tracking for diffusion-generated images, representing a novel method for a known bottleneck in multi-bit watermarking robustness.
The paper tackles the problem of robust multi-bit watermarking for diffusion-generated images, proposing OptMark which embeds watermarks in diffusion latents with structural and detail components, achieving robust resilience against various attacks while maintaining imperceptibility.
Watermarking diffusion-generated images is crucial for copyright protection and user tracking. However, current diffusion watermarking methods face significant limitations: zero-bit watermarking systems lack the capacity for large-scale user tracking, while multi-bit methods are highly sensitive to certain image transformations or generative attacks, resulting in a lack of comprehensive robustness. In this paper, we propose OptMark, an optimization-based approach that embeds a robust multi-bit watermark into the intermediate latents of the diffusion denoising process. OptMark strategically inserts a structural watermark early to resist generative attacks and a detail watermark late to withstand image transformations, with tailored regularization terms to preserve image quality and ensure imperceptibility. To address the challenge of memory consumption growing linearly with the number of denoising steps during optimization, OptMark incorporates adjoint gradient methods, reducing memory usage from O(N) to O(1). Experimental results demonstrate that OptMark achieves invisible multi-bit watermarking while ensuring robust resilience against valuemetric transformations, geometric transformations, editing, and regeneration attacks.