Search papers, labs, and topics across Lattice.
This paper investigates the efficacy of watermarking techniques as a defense against model stealing attacks that exploit black-box language models. By perturbing the logits layer, the authors present a novel approach to thwart these attacks while maintaining the model's performance. Empirical results indicate that their defense mechanism effectively mitigates information extraction without significantly degrading model quality across different configurations.
Watermarking can effectively safeguard LLMs from model stealing attacks without sacrificing performance.
Model stealing attacks have recently been introduced, enabling the extraction of precise information from black-box commercial language models. In this work, we propose defense methods against a recent attack of \cite{carlini2024stealing} and extensions for extracting the hidden layer dimension of production language models. Our methods are inspired by watermarking techniques that perturb the logits layer of these models to prevent such attacks. We provide empirical experiments demonstrating the effectiveness of the proposed defense versus model quality degradation across various configurations, and propose an effective defense against such attacks while preserving model utility.
