Search papers, labs, and topics across Lattice.
The paper introduces Test-Time Variational Synthesis (TTVS), a framework that allows Large Reasoning Models (LRMs) to self-evolve by dynamically augmenting the training stream from unlabeled test queries. TTVS uses Online Variational Synthesis to create diverse, semantically-equivalent variations of test queries and Test-time Hybrid Exploration to balance accuracy and consistency across these variants. Experiments demonstrate that TTVS outperforms existing test-time adaptation methods and even surpasses supervised RL-based techniques trained on large labeled datasets.
Forget expensive labeled data: this method lets large reasoning models learn and outperform supervised RL by dynamically generating training data from unlabeled test queries.
Despite significant advances in Large Reasoning Models (LRMs) driven by reinforcement learning with verifiable rewards (RLVR), this paradigm is fundamentally limited in specialized or novel domains where such supervision is prohibitively expensive or unavailable, posing a key challenge for test-time adaptation. While existing test-time methods offer a potential solution, they are constrained by learning from static query sets, risking overfitting to textual patterns. To address this gap, we introduce Test-Time Variational Synthesis (TTVS), a novel framework that enables LRMs to self-evolve by dynamically augmenting the training stream from unlabeled test queries. TTVS comprises two synergistic modules: (1) Online Variational Synthesis, which transforms static test queries into a dynamic stream of diverse, semantically-equivalent variations, enforcing the model to learn underlying problem logic rather than superficial patterns; (2) Test-time Hybrid Exploration, which balances accuracy-driven exploitation with consistency-driven exploration across synthetic variants. Extensive experiments show TTVS yields superior performance across eight model architectures. Notably, using only unlabeled test-time data, TTVS not only surpasses other test-time adaptation methods but also outperforms state-of-the-art supervised RL-based techniques trained on vast, high-quality labeled data.
