CRCLLGOct 11, 2023

A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models

arXiv:2310.07710v251 citationsh-index: 13
Originality Incremental advance
AI Analysis

This addresses the problem of maintaining content quality and detectability in machine-generated text for users needing reliable watermarking, though it is incremental as it builds on existing frameworks.

The paper tackles the challenge of preserving the original token distribution in watermarking for large language models, proposing DiPmark, which achieves distribution-preserving, accessible, and resilient watermarking with empirical validation across various models and tasks.

Watermarking techniques offer a promising way to identify machine-generated content via embedding covert information into the contents generated from language models. A challenge in the domain lies in preserving the distribution of original generated content after watermarking. Our research extends and improves upon existing watermarking framework, placing emphasis on the importance of a \textbf{Di}stribution-\textbf{P}reserving (DiP) watermark. Contrary to the current strategies, our proposed DiPmark simultaneously preserves the original token distribution during watermarking (distribution-preserving), is detectable without access to the language model API and prompts (accessible), and is provably robust to moderate changes of tokens (resilient). DiPmark operates by selecting a random set of tokens prior to the generation of a word, then modifying the token distribution through a distribution-preserving reweight function to enhance the probability of these selected tokens during the sampling process. Extensive empirical evaluation on various language models and tasks demonstrates our approach's distribution-preserving property, accessibility, and resilience, making it a effective solution for watermarking tasks that demand impeccable quality preservation.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes