Search papers, labs, and topics across Lattice.
The paper introduces R3-VAE, a novel VAE-based generative recommendation framework that addresses training instability and inefficient SID quality assessment in existing vector quantization methods. R3-VAE uses a reference vector as a semantic anchor, a dot product-based rating mechanism for training stabilization, and two SID evaluation metrics (Semantic Cohesion and Preference Discrimination) as regularization. Experiments on six benchmarks and a large-scale news recommendation platform demonstrate that R3-VAE outperforms state-of-the-art methods and significantly improves content cold start performance.
Forget finicky VQ-based recommendation models: R3-VAE's reference vector and rating-based regularization finally make them stable and effective enough for real-world deployment, boosting MRR by 1.62% in online A/B tests.
Generative Recommendation (GR) has gained traction for its merits of superior performance and cold-start capability. As the vital role in GR, Semantic Identifiers (SIDs) represent item semantics through discrete tokens. However, current techniques for SID generation based on vector quantization face two main challenges: (i) training instability, stemming from insufficient gradient propagation through the straight-through estimator and sensitivity to initialization; and (ii) inefficient SID quality assessment, where industrial practice still depends on costly GR training and A/B testing. To address these challenges, we propose Reference Vector-Guided Rating Residual Quantization VAE (R3-VAE). This framework incorporates three key innovations: (i) a reference vector that functions as a semantic anchor for the initial features, thereby mitigating sensitivity to initialization; (ii) a dot product-based rating mechanism designed to stabilize the training process and prevent codebook collapse; and (iii) two SID evaluation metrics, Semantic Cohesion and Preference Discrimination, serving as regularization terms during training. Empirical results on six benchmarks demonstrate that R3-VAE outperforms state-of-the-art methods, achieving an average improvement of 14.2% in Recall@10 and 15.5% in NDCG@10 across three Amazon datasets. Furthermore, we perform GR training and online A/B tests on a prominent news recommendation platform. Our method achieves a 1.62% improvement in MRR and a 0.83% gain in StayTime/U versus baselines. Additionally, we employ R3-VAE to replace the item ID of CTR model, resulting in significant improvements in content cold start by 15.36%, corroborating the strong applicability and business value in industry-scale recommendation scenarios.
