A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models
This addresses the problem of maintaining content quality and detectability in machine-generated text for users needing reliable watermarking, though it is incremental as it builds on existing frameworks.
The paper tackles the challenge of preserving the original token distribution in watermarking for large language models, proposing DiPmark, which achieves distribution-preserving, accessible, and resilient watermarking with empirical validation across various models and tasks.
Watermarking techniques offer a promising way to identify machine-generated content via embedding covert information into the contents generated from language models. A challenge in the domain lies in preserving the distribution of original generated content after watermarking. Our research extends and improves upon existing watermarking framework, placing emphasis on the importance of a \textbf{Di}stribution-\textbf{P}reserving (DiP) watermark. Contrary to the current strategies, our proposed DiPmark simultaneously preserves the original token distribution during watermarking (distribution-preserving), is detectable without access to the language model API and prompts (accessible), and is provably robust to moderate changes of tokens (resilient). DiPmark operates by selecting a random set of tokens prior to the generation of a word, then modifying the token distribution through a distribution-preserving reweight function to enhance the probability of these selected tokens during the sampling process. Extensive empirical evaluation on various language models and tasks demonstrates our approach's distribution-preserving property, accessibility, and resilience, making it a effective solution for watermarking tasks that demand impeccable quality preservation.