Search papers, labs, and topics across Lattice.
This paper introduces Dual-Embedding Watermarking (DEW), a novel semantic watermarking technique for large language models that enhances robustness against paraphrasing and translation by leveraging both contextual and token-level embeddings. By employing algebraic vector-space operations, DEW generates a watermark signal that retains detectability even as the text undergoes semantic shifts, outperforming traditional watermarking methods. Experimental results demonstrate that DEW significantly improves detection rates post-paraphrase while preserving text quality, making it a viable solution for ensuring the integrity of LLM-generated content.
DEW achieves robust watermarking that withstands semantic shifts, outperforming existing methods in detection after paraphrasing and translation.
This work presents Dual-Embedding Watermarking (DEW), a semantic watermarking scheme for large language models (LLMs) that leverages contextual and token-level embeddings to enhance robustness against paraphrasing and translation. DEW utilizes a signal-processing methodology, applying algebraic vector-space operations to token and context embeddings to derive a watermark signal that degrades gracefully under semantic shifts. The method obfuscates the watermark by projecting embedding vectors through pseudo-random matrices seeded with a secret key. Relevant distributions derived from the underlying algebra are evaluated and employed for statistical testing and benchmarking of DEW. Experimental results across multiple LLMs indicate that DEW improves post-paraphrase detection while maintaining competitive text quality, and remains detectable after translation, even when prior semantic watermarks degrade significantly. These findings position DEW as a practical and robust solution for safeguarding LLM-generated text and addressing critical issues in responsible AI deployment.
