Search papers, labs, and topics across Lattice.
This paper introduces GAS-Leak-LLM, a genetic algorithm-based approach for jailbreaking large language models (LLMs) by evolving adversarial suffixes in a black-box setting. The method highlights significant vulnerabilities in current safety mechanisms, demonstrating that adversarial prompts can be systematically optimized to bypass these defenses. Empirical results show that existing content moderation strategies are insufficient against this novel attack, underscoring the need for enhanced security measures in LLM deployment.
Current safety mechanisms for LLMs are critically flawed, as a genetic algorithm can effectively evolve adversarial prompts to bypass them entirely.
Large Language Models (LLMs) constitute pivotal components within the AI-dominated information technology ecosystem. To mitigate risks associated with harmful or policy-violating outputs, commercial systems employ advanced alignment strategies and multi-layered content moderation mechanisms. Despite these safeguards, recent research has demonstrated that LLMs remain vulnerable to adversarial manipulation, particularly through jailbreaking and prompt injection techniques. In this work, we propose GAS-Leak-LLM a novel jailbreaking attack based on a genetic algorithm that systematically evolves adversarial suffix to bypass safety constraints. Operating in a strict black-box setting, our method requires no access to model parameters or internals, thereby reflecting realistic threat scenarios in deployed systems. Through the iterative application of selection, mutation, and crossover heuristics, the framework systematically explores the discrete prompt space to identify high-fitness adversarial suffixes. Empirical findings reveal critical shortcomings in existing safety enforcement mechanisms and confirm the effectiveness and practical viability of the proposed attack.
