Search papers, labs, and topics across Lattice.
EmbTracker introduces a server-side black-box watermarking framework for Federated Language Models (FedLMs) that enables client-level traceability. It achieves this by injecting unique, identity-specific backdoor watermarks into models distributed to each client, detectable via API queries. Experiments on language and vision-language models show EmbTracker achieves near 100% verification rates, resilience against removal attacks, and minimal impact on primary task performance.
Pinpoint exactly which client leaked your federated model with a black-box watermark that's robust to fine-tuning, pruning, and quantization.
Federated Language Model (FedLM) allows a collaborative learning without sharing raw data, yet it introduces a critical vulnerability, as every untrustworthy client may leak the received functional model instance. Current watermarking schemes for FedLM often require white-box access and client-side cooperation, providing only group-level proof of ownership rather than individual traceability. We propose EmbTracker, a server-side, traceable black-box watermarking framework specifically designed for FedLMs. EmbTracker achieves black-box verifiability by embedding a backdoor-based watermark detectable through simple API queries. Client-level traceability is realized by injecting unique identity-specific watermarks into the model distributed to each client. In this way, a leaked model can be attributed to a specific culprit, ensuring robustness even against non-cooperative participants. Extensive experiments on various language and vision-language models demonstrate that EmbTracker achieves robust traceability with verification rates near 100\%, high resilience against removal attacks (fine-tuning, pruning, quantization), and negligible impact on primary task performance (typically within 1-2\%).
