Search papers, labs, and topics across Lattice.
This study investigates the conditions under which parameter addition in fine-tuning, known as task arithmetic, leads to predictable changes in model behavior by analyzing functional non-additivity across various task vectors. By employing a first-token predictive-distribution interaction ratio and norm-matched controls, the authors demonstrate that certain task combinations, particularly involving code and safety prompts, exhibit significant non-additivity, while others, like math prompts, do not. The findings reveal that weight-space composition can reliably inform functional outcomes across different models and adaptation methods, but it is not a universal predictor of merging performance.
Task arithmetic reveals that not all fine-tuning combinations yield predictable model behaviors, challenging assumptions about parameter addition's reliability.
Task arithmetic treats fine-tuning displacements as composable directions in weight space, yet it remains unclear when parameter addition reflects predictable changes in model function. We separate parameter geometry from functional geometry and measure pairwise functional non-additivity over a two-dimensional task-vector surface, using a first-token predictive-distribution interaction ratio conditioned on an input distribution and evaluated with norm-matched controls, three training seeds, and response-only fine-tuning. On Qwen2.5-1.5B, code+safety is more non-additive than the matched code+math control on code and instruction prompts, but not on math prompts. In a prospectively specified six-task expansion, all eight high-versus-low comparisons of unseen task pairs have the predicted sign. The primary ordering further persists under full-parameter fine-tuning at 0.5B, Qwen2.5 LoRA scale tests up to 7B, and a Llama-3.1-8B cross-architecture audit. External validation exposes a sharper boundary: raw public code, instruction, and safety prompts preserve the continuous contrast, whereas an instruction-style wrapper collapses it on the identical public-code prompts, and EvalPlus pass@1 interactions do not robustly reproduce it. Weight-space composition therefore supports coarse, input- and format-conditioned functional statements across adaptation methods, scales, and one additional model family, not a universal merging-performance predictor.
