Search papers, labs, and topics across Lattice.
This paper introduces SmartGR, a novel knowledge distillation framework designed to enhance generative recommendation systems by addressing specific challenges such as imbalanced distillation difficulty and incorrect prefix pruning during beam search. By implementing Hierarchy-Aware SID Distillation and Beam-Aware Ranking Distillation, SmartGR effectively transfers knowledge from a large teacher model to a lightweight student model. The results show an 8.6% performance improvement alongside a 2.39脳 increase in inference speed across four benchmark datasets, underscoring its practical applicability in real-world scenarios.
SmartGR achieves an 8.6% boost in recommendation performance while slashing inference time by over 2.3 times, tackling unique challenges in generative recommendation systems.
Generative recommendation (GR) has emerged as a promising paradigm for recommender systems. Scaling up GR models can improve recommendation performance, but it also substantially increases inference cost. Knowledge distillation provides a practical solution by transferring knowledge from a large GR model to a lightweight one. However, existing distillation methods do not account for two GR-specific challenges: imbalanced distillation difficulty across the semantic ID (SID) hierarchy and incorrect prefix pruning during beam search. To address these challenges, we propose SmartGR, a novel distillation framework that utilizes Hierarchy-Aware SID Distillation to transfer the teacher's modeling capability across the hierarchy and leverages Beam-Aware Ranking Distillation to distill the teacher's ranking preferences during beam search. Extensive experiments on four benchmark datasets demonstrate the effectiveness and efficiency of SmartGR, improving the performance by 8.6% while achieving a 2.39$\times$ inference speedup on average.
