Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the efficacy of instruction-based suppression in language models by probing hidden representations, analyzing attention patterns, and conducting semantic leakage experiments. The study reveals that prohibited concepts remain recoverable in hidden states and influence attention, even when models avoid generating prohibited content. This suggests a significant discrepancy between behavioral suppression and true representational alignment in transformers.
Even when LLMs appear to avoid generating prohibited content, the forbidden knowledge still lurks within their hidden states and subtly shapes their reasoning.
Instruction-based suppression is widely used to prevent language models from generating prohibited content, yet it remains unclear whether suppression reduces internal representation or merely suppresses expression. We investigate this question through representational probing, attention analysis, and behavioral semantic leakage experiments across multiple transformer models. We find that prohibited concepts remain highly recoverable from hidden representations under suppression, continue to influence attention routing, and measurably shape downstream generations despite successful lexical avoidance. These effects persist across pooling strategies, indirect semantic controls, and multiple model families. Our results expose a fundamental gap between behavioral and representational alignment.