Search papers, labs, and topics across Lattice.
This paper introduces Semantic-enhanced Federated User Behavior Modeling (SF-UBM), a novel federated learning framework to improve LLM-based recommendation systems while preserving user privacy across non-overlapping domains. SF-UBM uses natural language as a universal bridge for cross-domain alignment, employs fact-counter knowledge distillation to integrate domain-agnostic and specific knowledge, and projects user preferences into a soft prompt space to align behavioral and semantic spaces. Experiments on real-world datasets demonstrate that SF-UBM outperforms state-of-the-art privacy-preserving cross-domain recommendation methods.
You can boost LLM-based recommendations across completely disjoint domains without sacrificing user privacy by using semantic bridges and federated learning.
Large Language Models have shown great success in recommender systems. However, the limited and sparse nature of user data often restricts the LLM's ability to effectively model behavior patterns. To address this, existing studies have explored cross-domain solutions by conducting Cross-Domain Recommendation tasks. But previous methods typically assume domains are overlapped and can be accessed readily. None of the LLM methods address the privacy-preserving issues in the CDR settings, that is, Privacy-Preserving Cross-Domain Recommendation. Conducting non-overlapping PPCDR with LLM is challenging since: 1)The inability to share user identity or behavioral data across domains impedes effective cross-domain alignment. 2)The heterogeneity of data modalities across domains complicates knowledge integration. 3)Fusing collaborative filtering signals from traditional recommendation models with LLMs is difficult, as they operate within distinct feature spaces. To address the above issues, we propose SF-UBM, a Semantic-enhanced Federated User Behavior Modeling method. Specifically, to deal with Challenge 1, we leverage natural language as a universal bridge to connect disjoint domains via a semantic-enhanced federated architecture. Here, text-based item representations are encrypted and shared, while user-specific data remains local. To handle Challenge 2, we design a Fact-counter Knowledge Distillation module to integrate domain-agnostic knowledge with domain-specific knowledge, across different data modalities. To tackle Challenge 3, we project pre-learned user preferences and cross-domain item representations into the soft prompt space, aligning behavioral and semantic spaces for effective LLM learning. We conduct extensive experiments on three pairs of real-world domains, and the experimental results demonstrate the effectiveness of SF-UBM compared to the recent SOTA methods.
