Search papers, labs, and topics across Lattice.
This paper introduces a reinforcement learning framework to train large language models (LLMs) for generating interest-driven news search query lists from cross-domain user signals, addressing the challenge of capturing deeper, reusable user interests in news recommendation. They formulate query-list generation as a policy optimization problem, employing GRPO with multiple reward signals and systematically studying the impact of inference-time sampling and model capacity. The learned policy is then distilled from a large teacher model to a compact student model for scalable deployment, demonstrating significant improvements in interest modeling and recommendation performance through offline experiments and online A/B tests.
Scaling laws hold for interest modeling: bigger LLMs and more inference-time sampling consistently boost news recommendation quality, and can be distilled into smaller, deployable models.
News recommendation plays a critical role in online news platforms by helping users discover relevant content. Cross-domain news recommendation further requires inferring user's underlying information needs from heterogeneous signals that often extend beyond direct news consumption. A key challenge lies in moving beyond surface-level behaviors to capture deeper, reusable user interests while maintaining scalability in large-scale production systems. In this paper, we present a reinforcement learning framework that trains large language models to generate high-quality lists of interest-driven news search queries from cross-domain user signals. We formulate query-list generation as a policy optimization problem and employ GRPO with multiple reward signals. We systematically study two compute dimensions: inference-time sampling and model capacity, and empirically observe consistent improvements with increased compute that exhibit scaling-like behavior. Finally, we perform on-policy distillation to transfer the learned policy from a large, compute-intensive teacher to a compact student model suitable for scalable deployment. Extensive offline experiments, ablation studies and large-scale online A/B tests in a production news recommendation system demonstrate consistent gains in both interest modeling quality and downstream recommendation performance.
Microsoft Research