Search papers, labs, and topics across Lattice.
The authors establish Training-Free Task Vectors (TFTVs), an approach that maps activation steering vectors directly into rank-one weight-space updates using forward-pass statistics alone. This removes the computationally prohibitive requirement of fine-tuning across task pairs to isolate semantically meaningful directions for post-training weight arithmetic. Evaluations across LLM behavioral control benchmarks show TFTVs reliably support linear addition, subtraction, and multi-trait composition while matching or outperforming supervised editing baselines in trait modulation and general utility preservation.
Weight-space model editing no longer requires fine-tuning, as forward-pass activation vectors can be analytically converted into composable rank-one weight edits for precise behavioral control.
Task vectors enable post-training model editing by identifying semantically meaningful directions in weight space, typically computed as the difference between a fine-tuned model and its pretrained initialization. However, this reliance on fine-tuning makes discovering such directions costly and limits the practicality of post-training model editing. To address this limitation, we introduce Training-Free Task Vectors (TFTVs), a novel method to compute task-vector-like directions without requiring fine-tuning. Our method maps activation steering vectors to rank-one weight-space edits using only forward-pass statistics, while satisfying arithmetic properties that directly support learning via addition, forgetting via subtraction, and the composition of multiple edits. Empirically, we evaluate TFTVs on large language model behavioral control tasks and show that they consistently amplify, suppress, and compose target behaviors while preserving general knowledge and problem-solving skills. We also validate our method against other editing and steering baselines, experimentally demonstrating that TFTVs achieve stronger trait control with better or competitive utility preservation. We hope our work opens new directions for the community in post-training model editing and broader training-free model control. Code is available on the project website: tftv-llm.github.io.
