Search papers, labs, and topics across Lattice.
This paper introduces "subliminal steering," a novel method for transferring behavioral biases from a teacher to a student language model by using a steering vector trained to maximize the likelihood of target samples, rather than relying on system prompts. They demonstrate that this approach can transfer complex, multi-word biases, expanding the scope of subliminally transferable signals beyond single-word preferences. Mechanistically, they find that the student model not only inherits the behavioral bias but also encodes the steering vector itself, and a new steering vector trained on the student's data achieves high cosine similarity with the original teacher's steering vector, indicating precise bias encoding.
Subliminal learning can transfer not just behaviors, but the underlying steering vectors themselves, revealing a surprisingly precise encoding mechanism.
Subliminal learning describes a student language model inheriting a behavioral bias by fine-tuning on seemingly innocuous data generated by a biased teacher model. Prior work has begun to characterize this phenomenon but leaves open questions about the scope of signals it can transfer, the mechanisms that explain it, and the precision with which a bias can be encoded by seemingly unrelated data. We tackle all three problems by introducing subliminal steering, a variant of subliminal learning in which the teacher's bias is implemented not via a system prompt, as in prior work, but through a steering vector trained to maximize the likelihood of a set of target samples. First, we show that subliminal steering transfers complex multi-word biases, whereas prior work focused on single-word preferences, demonstrating a large scope of subliminally transferrable signals. Second, we provide mechanistic evidence that subliminal learning transfers not only the target behavioral bias, but also the steering vector itself, localized to the layers at which the teacher was steered. Finally, we show that the bias is encoded with surprising precision. We train a new steering vector directly on the subliminally-laden dataset and find that it attains high cosine similarity with the original vector.
