Search papers, labs, and topics across Lattice.
This paper introduces ReRec, a reinforcement fine-tuning (RFT) framework to improve LLM reasoning for complex recommendation tasks. ReRec uses dual-graph enhanced reward shaping, reasoning-aware advantage estimation, and an online curriculum scheduler to optimize LLMs. Experiments show ReRec outperforms state-of-the-art baselines while preserving instruction-following and general knowledge.
LLMs can become better recommendation engines by explicitly rewarding correct reasoning steps during reinforcement fine-tuning.
With the rise of LLMs, there is an increasing need for intelligent recommendation assistants that can handle complex queries and provide personalized, reasoning-driven recommendations. LLM-based recommenders show potential but face challenges in multi-step reasoning, underscoring the need for reasoning-augmented systems. To address this gap, we propose ReRec, a novel reinforcement fine-tuning (RFT) framework designed to improve LLM reasoning in complex recommendation tasks. Our framework introduces three key components: (1) Dual-Graph Enhanced Reward Shaping, integrating recommendation metrics like NDCG@K with Query Alignment and Preference Alignment Scores to provide fine-grained reward signals for LLM optimization; (2) Reasoning-aware Advantage Estimation, which decomposes LLM outputs into reasoning segments and penalizes incorrect steps to enhance reasoning of recommendation; and (3) Online Curriculum Scheduler, dynamically assess query difficulty and organize training curriculum to ensure stable learning during RFT. Experiments demonstrate that ReRec outperforms state-of-the-art baselines and preserves core abilities like instruction-following and general knowledge. Our codes are available at https://github.com/jiani-huang/ReRec.
