Search papers, labs, and topics across Lattice.
This paper introduces a novel white-box attack method for large language models (LLMs) that leverages associative context retrieval within a Knowledge Editing framework. By extending the editing process to encompass entire thematic categories instead of relying solely on predefined prompts, the authors enhance the attack's effectiveness while maintaining overall model performance. Experimental results across different architectures reveal that this approach significantly improves the likelihood of inducing unsafe behaviors in LLMs compared to existing methods.
Associative context retrieval can dramatically amplify the effectiveness of white-box attacks on LLMs without compromising their general performance.
As large language models (LLMs) are granted increasing autonomy, it is essential to investigate methods that can induce unsafe behavior. We propose a novel white-box attack inspired by locate-then-edit approaches from the field of Knowledge Editing. Our choice is motivated by the observation that models edited with such schemes tend to assign unusually high prediction probabilities to the edit target, a property that is particularly advantageous when designing attacks. We modify the editing framework by incorporating as- sociative knowledge retrieved from the model, thereby extending constraint removal to an entire thematic category rather than being limited to prompts from a predefined dataset. Experiments with various archi- tectures demonstrate improved attack effectiveness over competing methods without dealing critical damage to general model performance.
