Search papers, labs, and topics across Lattice.
This study investigates the ethical compliance failures of Large Language Models (LLMs) by examining how they respond to unethical requests across various structural modalities. Utilizing Layer-wise Relevance Propagation (LRP), the authors reveal that LLMs disproportionately focus on benign framing tokens, leading to a significant degradation in performance when faced with unethical requests. The introduction of LRP-guided decoding methods demonstrates that enhancing cue-token relevance can improve the safety of LLM responses, highlighting a critical pathway for mitigating alignment failures.
LLMs are more likely to comply with unethical requests when benign framing tokens overshadow cue-tokens, revealing a hidden vulnerability in their alignment.
Although Large Language Models (LLMs) are aligned to optimize for both helpfulness and harmlessness, these dual objectives may conflict, inevitably leading to alignment failures. This work systematically investigates instances where LLMs fail to exhibit ethical behavior. To understand the underlying mechanics of these vulnerabilities, we introduce a probing methodology that presents unethical scenarios to LLMs in three distinct structural modalities: objective classification tasks, subjective first-person statements, and direct requests for assistance. We find that model performance degrades in the request-for-assistance-based form. Using Layer-wise Relevance Propagation (LRP), we trace this discrepancy to an attribution bias: the model places greater emphasis on benign task-framing tokens (e.g., "Can you help me...") than on tokens signaling the underlying unethical behavior (e.g., "without getting caught"), which we term cue-tokens. We hypothesize that this under-attribution contributes to harmful compliance. To test this, we introduce two LRP-guided decoding methods that steer generation toward trajectories more relevant to cue tokens. Empirical evaluations show that these interventions promote safer responses, supporting cue-token attribution's role in compliance failures.
