Search papers, labs, and topics across Lattice.
This paper introduces the Yuanbao search agent, which utilizes a hybrid training framework that integrates agentic reinforcement learning with a cross-domain expert On-Policy Distillation (OPD) pipeline. By distilling knowledge from experts in complementary domains, the model achieves specialized search capabilities while simultaneously enhancing its general-purpose intelligence, effectively addressing the alignment tax often encountered in such optimizations. Experimental results show that Yuanbao not only performs competitively in search tasks but also improves its general capabilities, demonstrating a successful balance between specialization and generalization.
Achieving specialized search performance without sacrificing general intelligence, Yuanbao redefines the balance between focused capabilities and broad utility in autonomous agents.
Recent advances in Reinforcement Learning (RL) have substantially improved the capabilities of autonomous search agents, enabling sophisticated planning, and iterative retrieval over dynamic information sources. However, optimizing language models for specialized search behaviors often incurs an alignment tax, where gains in search performance come at the expense of general-purpose capabilities, limiting their effectiveness as universal assistants. In this technical report, we present the training framework behind the Yuanbao search agent, designed to achieve search specialization without sacrificing general intelligence. Built upon the Hunyuan3 architecture, our framework combines agentic reinforcement learning for autonomous search with a cross-domain expert On-Policy Distillation (OPD) pipeline. Experts specializing in complementary general-purpose domains are distilled into the search-specialized student, restoring and further enhancing its broad capabilities. Rather than treating specialization and general capability as competing objectives, our hybrid training strategy jointly optimizes both, effectively mitigating the alignment tax. Extensive experiments demonstrate that the resulting model achieves competitive search performance while consistently improving its general-purpose capabilities, providing a favorable balance between specialized execution and broad generalization in real-world search scenarios.
