Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SecRL-Prune, a structured pruning framework for CodeLLMs that leverages reinforcement learning to develop a layer-wise pruning policy while maintaining functionality-preserving code mutation capabilities. By evaluating the method on HumanEval, the authors demonstrate that SecRL-Prune achieves superior execution correctness and code diversity compared to existing structured pruning techniques, even under aggressive compression levels of 10-30%. Notably, the approach shows that significant pruning does not compromise the model's ability to generate adversarial code mutations, which is critical for understanding the security implications of deploying compressed CodeLLMs.
CodeLLMs can retain their adversarial mutation capabilities even after aggressive pruning, raising critical security concerns for malware detection systems.
Large code language models (CodeLLMs) can generate and rewrite programs, enabling functionality-preserving code mutation that may be used to create diverse malware variants and evade signature-based detection. A key security question is whether this mutation capability survives model compression, which would make deployment feasible under limited hardware budgets. We propose SecRL-Prune, a structured pruning framework for CodeLLMs that operates on feed-forward (MLP/FFN) channels. Starting from a pretrained teacher, it learns a layer-wise pruning policy with reinforcement learning using a teacher-student KL-divergence reward. To improve efficiency, we cache the teacher's top-P predictions once and compare the pruned student against this compact target, avoiding simultaneous teacher-student residency in GPU memory. We evaluate SecRL-Prune on HumanEval using pass@k for execution correctness and var@k for code diversity across three 7B CodeLLMs at 10-30% compression. SecRL-Prune consistently preserves higher pass@k and var@k than recent structured pruning baselines under aggressive pruning. In a case study on real malware samples, semantics-preserving mutations from 20%-pruned models substantially reduced detections. These results show that code mutation capability can survive significant structured pruning, highlighting the security relevance of compressed CodeLLMs.