Search papers, labs, and topics across Lattice.
This paper introduces DuELRec, a novel model designed to enhance Cross-Domain Sequential Recommendation (CDSR) by addressing the issue of negative transfer through a dual-expert framework that leverages Large Language Models (LLMs). By implementing a domain-gated mechanism and item-aware attention transformation, DuELRec effectively differentiates between single-domain and cross-domain interactions, allowing for improved aggregation of item-level collaborative signals. Experimental results demonstrate that DuELRec significantly outperforms 26 existing state-of-the-art methods, highlighting its efficacy in mitigating knowledge transfer issues in CDRS tasks.
Negative transfer in cross-domain recommendations can be effectively mitigated with a dual-expert LLM approach that enhances item-level understanding.
Cross-Domain Sequential Recommendation (CDSR) predicts the next item a user will interact with based on their historical interaction sequences across multiple domains. Recent approaches leverage Large Language Models (LLMs) finetuned on textual representations of cross-domain user sequences to retrieve the recommended items, referred to as LLMRec. However, LLMRec primarily models the autoregressive patterns of token-level item texts, while overlooking item-level collaborative signals. This semantic misalignment often leads to distorted knowledge transfer across domains-termed negative transfer degrading performance in the CDSR task. To address this issue, we propose a novel LLM-based CDSR model, DuELRec: Domain-Gated Dual Experts with LLMs for Cross-Domain Sequential Recommendation. We propose a domain-gated dual-expert framework, equipped with an item-aware attention transformation module, which aggregates textual subtokens into item-level representations and enforces block-level attention masking. The single-domain expert restricts autoregressive attention to items within the same domain, while the cross-domain expert allows it across all domains. A gating mechanism adaptively fuses their outputs, using single-domain signals to reduce cross-domain noise that causes negative transfer. Second, we introduce a dual-sampling token-to-item contrastive learning objective that allows LLMs to capture the item-level collaborative signals from both single- and cross-domains. This is achieved by transforming token-level item texts into item-level representations and applying stochastic negative sampling from both single- and cross-domain item pools for contrastive learning. Extensive experiments on two real-world datasets across ten domains show that our model outperforms 26 state-of-the-art methods in recommendation performance.
