Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces GuardNet, an ensemble system of shallow neural networks designed to enhance the detection of Prompt Injection (PI) and Jailbreak (JB) attacks on Large Language Models (LLMs). The authors hypothesize that robustness against adversarial attacks is more reliant on the diversity of training examples and effective threshold calibration rather than on the scale of the model. GuardNet achieves an AUROC of 0.747 and an F1 score of 0.92 on benchmark datasets, demonstrating competitive performance with low latency, making it viable for real-world applications despite the superior performance of larger models.
GuardNet shows that a diverse ensemble of shallow networks can outperform larger models in robustness against adversarial attacks while maintaining low latency.
Large Language Models (LLMs) have transformed natural language processing, but they remain vulnerable to Prompt Injection (PI) and Jailbreak (JB) attacks. In addition, benchmark evaluations may be affected by contamination and partial information leakage, compromising performance estimates. This work presents GuardNet, a guardrail system based on an ensemble of shallow neural networks (BiLSTMs) with approximately 47 million parameters. We investigate the hypothesis that robustness in adversarial scenarios depends more on the diversity of example coverage and threshold calibration than on model scale. The results indicate that GuardNet achieves competitive performance compared with lightweight detectors and high efficiency at low latency, although larger LLMs such as Mistral-7B and Llama-3.1-8B still achieve superior performance in terms of F1 score and AUROC on the blind JBB-Behaviors benchmark. Nevertheless, GuardNet achieves an AUROC of 0.747 on the blind dataset (n = 200) and an F1 score of 0.92 on a proprietary benchmark (n = 50), under threshold calibration and evaluation with declared partial information leakage. The system operates with an average latency of approximately 50 ms on CPU, making it suitable for deployment in production environments with cost and infrastructure constraints.