Search papers, labs, and topics across Lattice.
This paper introduces LineageMark, a novel multi-user white-box watermarking framework designed to trace contributions in model derivation chains within open large language model ecosystems. By employing a projection-based approach to encode watermarks in model parameters, LineageMark ensures that contributor watermarks remain intact across multiple stages of model adaptation and incremental updates. Experimental results demonstrate its effectiveness in preserving watermark integrity against various perturbations, thus enhancing model provenance and intellectual property protection in collaborative AI development environments.
LineageMark ensures that contributor watermarks survive multiple model adaptations, maintaining integrity even under fine-tuning and pruning.
In open large language model (LLM) ecosystems, models are frequently adapted across multiple domains and applications, forming multi-stage derivation chains. Consequently, tracking and verifying historical contributions is essential for model provenance and intellectual property protection. However, existing watermarking methods are mainly designed for single-user, one-time embeddings, often fail under repeated model derivation and incremental updates. To address this problem, we propose LineageMark, a multi-user white-box watermarking framework for model derivation chains. The framework encodes watermarks in model parameters using a projection-based approach. Stable carriers are first selected to reduce sensitivity to model changes, each watermark bit is then represented as a projection statistic over these carriers. Additional watermark insertions introduce only bounded perturbations in the projection space, and margin constraints are used to maintain signal integrity. We evaluate the effectiveness of LineageMark in multi-stage model derivation chains. Experimental results show that LineageMark preserves contributor watermarks across multi-stage derivation and supports incremental multi-user watermark insertion. Furthermore, it exhibits robustness against perturbations such as re-watermarking, fine-tuning, quantization, and pruning.
