Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
This paper investigates the prevalence and implications of natural backdoor vulnerabilities in Code Language Models (CodeLMs), revealing that such vulnerabilities are intrinsic to these models across various architectures and tasks. The study examines 44 scenarios, highlighting significant differences between natural and injected backdoor vulnerabilities and their transferability across datasets and model architectures. To address these vulnerabilities, the authors introduce ScanNBT, a novel detection method aimed at improving the identification of natural backdoor threats in CodeLMs, thereby enhancing overall security measures in code intelligence applications.
Natural backdoor vulnerabilities are not just a theoretical concern; they are prevalent in CodeLMs and can significantly compromise code security.
Code Language Models (CodeLMs) have become integral to software engineering, significantly advancing code intelligence tasks. However, their widespread adoption has raised critical security concerns, particularly regarding susceptibility to backdoor attacks. Recent studies have uncovered naturally occurring backdoors, referred to as natural backdoors, in normally trained deep learning models. Despite posing threats as serious as those introduced through data poisoning, security implications of natural backdoor vulnerabilities in CodeLMs remain poorly understood. In this paper, we conduct a thorough empirical study of natural backdoor vulnerabilities in CodeLMs across various model architectures and code intelligence tasks. Specifically, we examine potential natural backdoor vulnerabilities across 44 scenarios, demonstrating that natural backdoors are prevalent and intrinsic to CodeLMs. We reveal differences between injected and natural backdoor vulnerabilities at both the model and parameter levels. We then analyze the transferability of natural backdoor vulnerabilities from three perspectives: datasets, model architectures, and shared knowledge. We further investigate the causes of natural backdoors from two aspects: training datasets and the model training procedure. We evaluate existing backdoor defense techniques, including pre-training, in-training, and post-training defenses, in mitigating natural backdoors. Finally, we propose ScanNBT, a novel detection method designed to improve comprehensive detection of natural backdoor vulnerabilities in CodeLMs. We aim for our findings to enhance understanding of these vulnerabilities and provide insights for strengthening CodeLM security against backdoor threats.
Tsinghua AI