Mask-Free Privacy Extraction and Rewriting: A Domain-Aware Approach via Prototype Learning
This work addresses the challenge of balancing privacy and utility in LLM-based text rewriting for privacy-sensitive domains, offering a fully automated solution that eliminates the need for manual annotations or brittle dictionaries.
DAMPER introduces a domain-aware approach for client-side privacy rewriting that uses prototype learning to localize and rewrite private spans without manual masks, achieving superior privacy-utility trade-offs compared to existing methods.
Client-side privacy rewriting is crucial for deploying LLMs in privacy-sensitive domains. However, existing approaches struggle to balance privacy and utility. Full-text methods often distort context, while span-level approaches rely on impractical manual masks or brittle static dictionaries. Attempts to automate localization via prompt-based LLMs prove unreliable, as they suffer from unstable instruction following that leads to privacy leakage and excessive context scrubbing. To address these limitations, we propose DAMPER (Domain-Aware Mask-free Privacy Extraction and Rewriting). DAMPER operationalizes latent privacy semantics into compact Domain Privacy Prototypes via contrastive learning, enabling precise, autonomous span localization. Furthermore, we introduce a Prototype-Guided Preference Alignment, which leverages learned prototypes as semantic anchors to construct preference pairs, optimizing a domain-compliant rewriting policy without human annotations. At inference time, DAMPER integrates a sampling-based Exponential Mechanism to provide rigorous span-level Differential Privacy (DP) guarantees. Extensive experiments demonstrate that DAMPER significantly outperforms existing baselines, achieving a superior privacy-utility trade-off.