Search papers, labs, and topics across Lattice.
ARIADNE introduces a training-free, adapter-agnostic framework for dynamic selection of task-specialized adapters during inference, addressing the challenge of selecting appropriate adapters without task labels. By representing each adapter with centroids derived from its training set embeddings, ARIADNE measures proximity in latent space to efficiently choose the best adapter for unlabeled inputs. Evaluated on 23 diverse NLP tasks, it achieves 97.44% of the upper bound performance and maintains 89.7% average selection accuracy across 44 tasks, showcasing its scalability and compatibility with various parameter-efficient fine-tuning methods.
Achieving 97.44% of optimal performance without any adapter training or internal access, ARIADNE revolutionizes how we dynamically select task-specific models at inference time.
The increasing deployment of parameter-efficient fine-tuning (PEFT) has led to model ecosystems in which a single backbone is paired with many task-specialized adapters. In this setting, inference-time queries often arrive without task labels, requiring the system to automatically select the most appropriate adapter from a growing and heterogeneous adapter pool. Existing routing methods either depend on access to adapter internals, such as weight decompositions or gradient-based statistics, or require additional router training, which limits scalability and portability as new adapters are added. We introduce ARIADNE, a training-free, adapter-agnostic routing framework for dynamic adapter selection at inference time. ARIADNE represents each adapter through a set of centroids computed from embeddings of its training set, capturing the data distribution associated with that adapter. Given an unlabeled input, it selects an adapter by measuring proximity to these centroids in latent space. Because routing is performed entirely in the input embedding space, ARIADNE is compatible with arbitrary PEFT methods and requires no modification to the adapters or training procedures. Primarily evaluated with Llama 3.2 1B Instruct on 23 diverse NLP tasks, ARIADNE recovers 97.44% of the upper bound performance. Scaling to 44 tasks, it achieves 89.7% average selection accuracy, without additional training or access to adapter internals.
