Search papers, labs, and topics across Lattice.
This paper introduces ORBIT, a training-free method for multi-attribute behavioral steering in language models, addressing the limitations of existing single-attribute steering techniques. By employing singular value decomposition to construct a joint subspace and applying a norm-preserving rotation, ORBIT effectively manages multiple behavioral attributes simultaneously without the need for retraining. Evaluations on the TraitFactory and ToneBank benchmarks demonstrate that ORBIT outperforms existing methods in achieving balanced multi-attribute steering while maintaining output coherence across various models.
ORBIT achieves superior multi-attribute steering in language models without the need for retraining, overcoming the limitations of previous methods that struggle with norm imbalance and directional cancellation.
Language models are widely used in assistant settings, where controlling behavioral attributes is often essential. Activation steering modifies hidden-state representations at inference time, providing a lightweight, training-free mechanism that can be toggled at runtime. Existing methods, however, have focused primarily on steering a single attribute at a time. When multiple attributes must be controlled simultaneously, naive summation of per-attribute steering vectors suffers from norm imbalance and directional cancellation, while classifier-based approaches require retraining whenever the attribute set changes. We introduce ORBIT (Orthogonal Rotation-Based Intervention Technique), a training-free extension of rotation-based steering to the multi-attribute setting. Our method constructs a joint subspace from per-attribute steering planes via singular value decomposition and applies a single norm-preserving rotation within that subspace toward a combined target direction. Adaptive per-token gating identifies which attributes need correction at each position, and an optional additive boost strengthens attributes with weak initial projection. We also introduce TraitFactory, a new multi-attribute benchmark that focuses on behavioral tendencies rather than surface-level style. We evaluate ORBIT on TraitFactory and ToneBank across three models (Llama-3.2-3B, Qwen-2.5-7B, Llama-3.1-8B) while steering multiple attributes simultaneously, showing that it achieves stronger and more balanced multi-attribute steering than existing training-free baselines while better preserving output coherence.
