Search papers, labs, and topics across Lattice.
This paper introduces the Steerable Model Merging (ST-Merge) framework, which enhances multilingual reasoning by adaptively modulating the contributions of different source models through a gated cross-attention mechanism. The approach addresses the limitations of traditional model merging, which often leads to conflicts and suboptimal performance due to a one-size-fits-all strategy. Experimental results show that ST-Merge significantly outperforms several strong baselines across four multilingual reasoning benchmarks in 21 languages, highlighting its effectiveness in improving model performance in diverse contexts.
Adaptive weighting in model merging can drastically improve multilingual reasoning performance, outperforming traditional methods across 21 languages.
Model merging is an effective technique for composing the capabilities of a multilingual model and a reasoning model. It has achieved promising generalization in multilingual reasoning tasks by aligning feature spaces of different models. However, the merged single model often fails to address the conflicts between source models, leading to suboptimal performance. In other words, the one-size-fits-all merging strategy may not align with the characteristics of different inputs which may require prioritizing certain models over others. To this end, we propose a Steerable Model Merging (ST-Merge) framework to modulate the contribution of each source model. To realize this idea, we introduce a gated cross-attention mechanism to weight or filter the two attended source models in an adaptive manner. Extensive experiments demonstrate that ST-Merge consistently outperforms multiple strong baselines on four multilingual reasoning benchmarks across 21 different languages.
Tsinghua AI