Search papers, labs, and topics across Lattice.
The paper introduces MC$^2$Mark, a multi-bit watermarking framework for long messages in text generated by large language models, addressing the trade-off between text quality and watermark strength. MC$^2$Mark employs Multi-Channel Colored Reweighting to encode bits through structured token reweighting that maintains an unbiased token distribution, combined with Multi-Layer Sequential Reweighting for signal amplification and an evidence-accumulation detector for message recovery. Experiments demonstrate that MC$^2$Mark significantly improves watermark detectability and robustness while preserving generation quality, outperforming existing methods, especially for long messages, by nearly 30%.
Achieve near-perfect accuracy for short watermarked messages and a 30% improvement for long messages with MC$^2$Mark, a new watermarking scheme that balances watermark strength and text quality.
Large language models now produce text indistinguishable from human writing, which increases the need for reliable provenance tracing. Multi-bit watermarking can embed identifiers into generated text, but existing methods struggle to keep both text quality and watermark strength while carrying long messages. We propose MC$^2$Mark, a distortion-free multi-bit watermarking framework designed for reliable embedding and decoding of long messages. Our key technical idea is Multi-Channel Colored Reweighting, which encodes bits through structured token reweighting while keeping the token distribution unbiased, together with Multi-Layer Sequential Reweighting to strengthen the watermark signal and an evidence-accumulation detector for message recovery. Experiments show that MC$^2$Mark improves detectability and robustness over prior multi-bit watermarking methods while preserving generation quality, achieving near-perfect accuracy for short messages and exceeding the second-best method by nearly 30% for long messages.
