Search papers, labs, and topics across Lattice.
This paper introduces BAR (Branch-Adapt-Route), a modular approach for extending language models by training independent domain experts through separate mid-training, supervised fine-tuning, and reinforcement learning pipelines. The method allows for independent updates of these experts using a Mixture-of-Experts architecture, achieving linear cost scaling and preventing degradation of existing capabilities, unlike traditional monolithic retraining methods. Evaluations show that BAR matches or exceeds the performance of retraining baselines while avoiding catastrophic forgetting, demonstrating a scalable alternative for enhancing language models with new domain capabilities.
Modular training with BAR allows independent updates of domain experts, achieving superior performance without the pitfalls of catastrophic forgetting.
Extending a fully post-trained language model with new domain capabilities is fundamentally limited by monolithic training paradigms: retraining from scratch is expensive and scales poorly, while continued training often degrades existing capabilities. We present BAR (Branch-Adapt-Route), which trains independent domain experts, each through its own mid-training, supervised finetuning, and reinforcement learning pipeline, and composes them via a Mixture-of-Experts architecture with lightweight router training. Unlike retraining approaches that mix all domains and require full reprocessing for any update (with cost scaling quadratically), BAR enables updating individual experts independently with linear cost scaling and no degradation to existing domains. At the 7B scale, with experts for math, code, tool use, and safety, BAR achieves an overall score of 49.1 (averaged across 7 evaluation categories), matching or exceeding re-training baselines (47.8 without mid-training, 50.5 with). We further show that modular training provides a structural advantage: by isolating each domain, it avoids the catastrophic forgetting that occurs when late-stage RL degrades capabilities from earlier training stages, while significantly reducing the cost and complexity of updating or adding a domain. Together, these results suggest that decoupled, expert-based training is a scalable alternative to monolithic retraining for extending language models.
AI2
UW