Search papers, labs, and topics across Lattice.
This paper addresses the dual threats of illegal model training and malicious data leakage in deep learning by proposing a novel copyright protection mechanism that generates unlearnable perturbations. By minimizing the mutual information between input images and model outputs, the method ensures that the model learns uncorrelated features, thereby enhancing generalizability. Additionally, a dual extraction strategy using two distinct watermark extractors mitigates the negative impact of these perturbations on watermark extraction, demonstrating effective copyright protection across multiple image datasets, including ImageNet and CIFAR10.
Unlearnable perturbations can safeguard copyright by ensuring models learn irrelevant features, thwarting both unauthorized training and data leakage.
Significant advancements in deep learning have been made possible by the utilization of large datasets, underscoring the critical importance of copyright protection. Adding meticulously designed perturbations to examples, making them unlearnable has become a crucial approach for safeguarding data copyright. Existing methods for creating unlearnable examples overlook the risk of data leakage, which can threaten data ownership. Thus, copyright protection in deep learning faces two main threats: illegal model training and malicious data leakage. We investigate that these two threats cannot be solved by straightforwardly combining existing availability attacks and watermarking techniques as their negative interaction effects. Therefore, in this paper, we propose a novel copyright protection mechanism for the aforementioned security concerns. Considering that the prevention of unauthorized model training requires powerful generalizability of unlearnable perturbations, we generate perturbations to induce the model to learn uncorrelated features of input images. It works by minimizing the mutual information of the input and output of the model. On the other hand, to eliminate the side impact of unlearnable perturbations on the watermark extraction, we design a dual extraction strategy by using two distinct watermark extractors. Extensive experiments on the image datasets ImageNet, CIFAR10, and Pets show that our proposed method could provide comprehensive copyright protection to images. The code is available at https://github.com/Yeah21/ReversibleUnlearnableExamples
