Search papers, labs, and topics across Lattice.
This paper introduces LaRec, a generative recommendation framework that leverages latent reasoning in large language models (LLMs) to enhance recommendation efficiency and effectiveness. By implementing a two-stage approach that includes Latent Pre-training for rich supervisory signals and Personalized RL-tuning for diverse reasoning path exploration, LaRec addresses the challenges of fine-grained supervision and limited exploration in traditional latent reasoning methods. Experimental results demonstrate that LaRec significantly outperforms existing baselines while maintaining comparable efficiency, highlighting its potential in improving recommendation systems.
LaRec transforms LLM-based recommendations by enabling efficient exploration of diverse user interests through personalized latent reasoning paths.
Large Language Models (LLMs) have shown great promise in recommendation due to superior reasoning abilities. However, existing methods mainly rely on explicit Chain-of-Thought (CoT), resulting in verbose reasoning texts and inefficient response times. latent reasoning aims to balance efficiency by thinking within a continuous latent space, yet it faces two major challenges: (1) Lack of Fine-grained Supervision: Latent reasoning relies solely on feedback from the final labels, providing sparse supervisory signals that struggle to effectively guide the optimization of multiple hidden reasoning steps. (2) Single Reasoning Path: The deterministic nature of latent reasoning impedes the exploration of users'diverse interests and preferences, thereby limiting the recommendation capabilities of LLMs. To address these issues, we propose \textbf{$LaRec$}, an efficient generative recommendation framework designed to unleash the potential of latent reasoning in LLMs. $LaRec$ consists of two core stages: First, we design Latent Pre-training that empowers LLMs with latent reasoning capabilities by providing rich supervisory signals to the latent space reasoning via step-level alignment and process direction alignment. Second, we introduce Personalized RL-tuning. Specifically, we construct a personalized Gaussian Mixture Distribution for each user based on their historical interests. By randomly sampling distinct reasoning starting points from this distribution during training, we guide the LLMs to traverse diverse reasoning paths within the latent space, enabling efficient exploration of user's multi-faceted interests. Experiments on multiple datasets show that $LaRec$ significantly outperforms existing baselines with comparable efficiency.
