Search papers, labs, and topics across Lattice.
The paper introduces CC-BOS, a novel framework for automatically generating classical Chinese adversarial prompts to jailbreak LLMs in black-box settings, exploiting the language's conciseness and obscurity to bypass safety constraints. CC-BOS encodes prompts into eight policy dimensions and uses multi-dimensional fruit fly optimization with smell search, visual search, and Cauchy mutation to efficiently explore the search space. Experiments demonstrate that CC-BOS consistently outperforms state-of-the-art jailbreak attack methods, highlighting the vulnerability of LLMs to classical Chinese prompts.
Classical Chinese, with its conciseness and obscurity, unlocks a surprisingly effective attack vector against LLM safety filters, and can be automatically exploited via bio-inspired optimization.
As Large Language Models (LLMs) are increasingly used, their security risks have drawn increasing attention. Existing research reveals that LLMs are highly susceptible to jailbreak attacks, with effectiveness varying across language contexts. This paper investigates the role of classical Chinese in jailbreak attacks. Owing to its conciseness and obscurity, classical Chinese can partially bypass existing safety constraints, exposing notable vulnerabilities in LLMs. Based on this observation, this paper proposes a framework, CC-BOS, for the automatic generation of classical Chinese adversarial prompts based on multi-dimensional fruit fly optimization, facilitating efficient and automated jailbreak attacks in black-box settings. Prompts are encoded into eight policy dimensions-covering role, behavior, mechanism, metaphor, expression, knowledge, trigger pattern and context; and iteratively refined via smell search, visual search, and cauchy mutation. This design enables efficient exploration of the search space, thereby enhancing the effectiveness of black-box jailbreak attacks. To enhance readability and evaluation accuracy, we further design a classical Chinese to English translation module. Extensive experiments demonstrate that effectiveness of the proposed CC-BOS, consistently outperforming state-of-the-art jailbreak attack methods.
Tsinghua AI