Search papers, labs, and topics across Lattice.
This paper introduces DLMRec, a discrete diffusion language model designed specifically for recommendation systems, addressing the limitations of traditional autoregressive methods that prioritize sequential order over the complex inter-item dependencies of user preferences. By incorporating a collaborative-aware stochastic tokenizer, a curriculum-driven training strategy, and a stability-aware voting mechanism, DLMRec enhances the model's ability to generate more accurate and robust recommendations. The key result demonstrates that DLMRec outperforms existing autoregressive models in generating recommendations that better align with user preferences, showcasing its potential for improving generative recommendation systems.
DLMRec redefines recommendation generation by leveraging diffusion modeling to capture complex user preferences more effectively than traditional autoregressive approaches.
Large language model (LLM)-empowered recommender systems have emerged as a promising paradigm for generative recommendation, leveraging their strong semantic reasoning and generative capacity to model complex, diverse user preferences. However, most existing approaches rely on an autoregressive paradigm that is suboptimal for recommendation. The next-token objective emphasizes sequential order rather than the structural inter-item dependencies underlying user preferences. In addition, prefix-constrained generation restricts bidirectional context and commits to left-to-right decoding, causing early errors to accumulate without correction. Inspired by the success of diffusion language models, we propose \textbf{DLMRec}, a discrete diffusion language model tailored for recommendation that offers a compelling alternative to autoregressive generation. Specifically, DLMRec introduces three key components to bridge diffusion language modeling with recommendation. First, a collaborative-aware stochastic tokenizer encodes multi-hop collaborative signals into expressive discrete tokens compatible with diffusion modeling. Second, a curriculum-driven training strategy aligns the denoising process with preference recovery through progressive item- and token-level learning. Third, a stability-aware voting mechanism aggregates iterative predictions to improve generation consistency and robustness.
