Search papers, labs, and topics across Lattice.
This study investigates the impact of activation source selection on the effectiveness of activation steering in language models, revealing that the choice of source context and activation readout policy significantly influences steering success. By analyzing three instruction-tuned models across four steering task families, the authors demonstrate that effective steering signals are derived from execution-boundary states, rather than merely from the presence of desired behaviors in the source text. The introduction of tail subtraction further refines steering signals by eliminating shared semantics, leading to more stable and effective steering outcomes.
Steering signals are most effective when derived from execution-boundary states, not just from the presence of desired behaviors in the source text.
Activation steering controls language models by adding vectors or features to hidden states at inference time, but the upstream source of these steering signals is often treated as a secondary detail. We study this source choice as activation source selection: the combination of source context and activation readout policy used to collect the hidden states from which a steering signal is built. Holding the downstream intervention fixed, we show across three instruction-tuned models and four steering task families that changing only the source activations substantially changes steering success. We further find that effective steering is not explained simply by whether the desired behavior appears in the source text. Instead, strong signals come from execution-boundary states, where the model is about to produce or continue the target behavior. This pre-/post-realization distinction explains why answer-based sources sometimes work: their useful component aligns with execution-boundary directions rather than target appearance alone. Building on this view, we introduce tail subtraction, which removes shared prompt and continuation semantics from boundary states and yields cleaner, more stable steering signals. Overall, our results suggest that steering depends on representations of what the model is about to do, not merely on what has already appeared.