Search papers, labs, and topics across Lattice.
The authors evaluate whether LLM activation steering vectors capture coherent semantic geometry using a 26K-sample benchmark grounded in Schwartz's Theory of Basic Human Values across diverse model families and scales. While distribution-driven methods (e.g., CAA, SphericalSteer) accurately recover theoretical human value topologies (Spearman 蟻 up to 0.51) and enable coherent cross-value transfer, behavior-centric methods rely on shortcut representations that fail to reflect value geometry despite comparable task performance. Crucially, latent geometric fidelity improves with raw model scale but consistently deteriorates following instruction tuning, revealing a disconnect between surface-level alignment and internal representation structure.
Instruction tuning degrades the latent moral geometry of LLMs, even though distribution-driven steering vectors can naturally mirror human value topologies to enable coherent cross-value generalization.
As large language models (LLMs) are increasingly deployed in alignment-sensitive contexts, activation steering has emerged as a lightweight, inference-time alternative to fine-tuning methods (e.g., RLHF, DPO) for behavioral control. However, existing work typically validates steering on isolated behaviors, leaving it unclear whether steering vectors encode coherent semantic structure or merely exploit behavior-specific shortcuts. We investigate whether the latent geometry of LLM steering vectors reflects theory-specified structure in human values and morality. Using Schwartz's Theory of Basic Human Values as our primary fine-grained framework, we introduce a 26K-sample benchmark covering 20 human values and analyze distribution-driven methods (e.g., CAA, SphericalSteer, ODESteer) and behavior-centric approaches (e.g., COLD-Steer, BiPO) across diverse model families and sizes. We find that distribution-driven methods recover human value topologies aligned with theoretical predictions (Spearman 蟻 up to 0.51, p < 10^{-13}). In contrast, behavior-centric methods achieve comparable steering performance but show little correlation with the expected value geometry. Geometric fidelity improves with model scale but drops after instruction tuning. Finally, better geometric alignment also leads to more human-consistent transfer across values: steering one value correctly lifts compatible values and suppresses opposing ones. Code and data are available at: https://github.com/DeepRCL/Steering_Geometry.
