Search papers, labs, and topics across Lattice.
This paper formalizes the problem of Continual Model Routing (CMR) in evolving AI model hubs, where routing mechanisms must adapt to a growing number of models and tasks. They introduce CMRBench, a large-scale benchmark with over 2,000 models, to simulate realistic hub expansion. The authors propose CARvE, a contrastive embedding approach using checkpoint-based anchoring and structured replay, which outperforms existing methods in model, family, and domain-level accuracy on CMRBench.
Training a single routing model can now effectively navigate thousands of evolving AI models, outperforming fine-tuning and adapter-based approaches.
AI model hubs provide access to a rapidly growing collection of powerful pre-trained models, enabling off-the-shelf mixture-of-experts systems with different routing strategies. However, this rapid growth poses two fundamental challenges: scaling model selection across thousands of experts and continually updating routing mechanisms as new models and tasks are introduced. In this paper, we formalise this setting as Continual Model Routing (CMR) and propose CMRBench, a new large-scale benchmark simulating realistic hub expansion and including over 2,000 candidate models. Finally, we introduce CARvE, a contrastive embedding approach for efficient continual model routing via checkpoint-based anchoring and structured replay. Extensive empirical results and ablations show that CARvE significantly outperforms zero-shot retrieval, fine-tuning, and adapter-merging baselines in model, family, and domain-level accuracy.
