Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the potential for non-expert malicious actors to exploit large language models (LLMs) through effective jailbreaks and malicious queries. Utilizing a multi-armed bandit approach, the authors efficiently identify optimal jailbreaks from a vast selection, achieving a remarkable average success rate of 97% across 15 state-of-the-art open-weight LLMs. Additionally, the research introduces the FrankensteinBench, a comprehensive benchmark of 11,279 malicious queries, revealing that increased query complexity can enhance attack success rates by up to 26%.
Non-expert attackers can achieve a staggering 97% success rate in exploiting LLMs by leveraging a novel bandit-based strategy for optimal jailbreak selection.
With a profusion of jailbreaks for LLMs now widely known, a growing concern is that non-expert malicious actors ("the average Jane") could elicit actionable responses to malicious requests. In this work, we examine whether this concern is justified. A non-expert malicious actor requires two ingredients for a successful attack: a powerful jailbreak for their target model, acting on an effective malicious query. For the former, we propose a novel attack strategy based on the multi-armed bandit framework. This allows efficient online learning of the optimal jailbreak from a large choice set via noisy exploration on a small number of queries, with subsequent application of the learnt policy on an exploitation set. For the latter, we curate $\mathrm{FrankensteinBench}$, a safety benchmark of $11,279$ malicious queries drawn from manual curation over $7$ existing benchmarks, along with automated enhancement and generation. Each query is categorized as simple or complex by the technical expertise required to craft it. Our findings confirm the concern. Our bandit-based attack achieves success rates as high as $97\%$ on average over $15$ SoTA open-weight LLMs. Moreover, adding complexity to queries raises the attack success rate by up to $26\%$ on average across models -- making it an effective, automatable prompting strategy.