Search papers, labs, and topics across Lattice.
The paper introduces MixRAGRec, a multi-agent framework for knowledge graph retrieval-augmented generation (KG-RAG) in LLM-based recommendation systems, designed to address the limitations of existing methods in handling varying query complexities and structural information loss. It employs a Mixture-of-Experts Retrieval Agent for adaptive KG retrieval granularity, a Knowledge Preference Alignment Agent for converting structured knowledge into LLM-friendly text, and a Contrastive Learning-reinforced Recommendation Agent trained with contrastive preference feedback. The framework is trained using Mixture-of-Experts Multi-Agent Policy Optimization (MMAPO), and experiments on real-world datasets demonstrate its effectiveness.
LLM-based recommendation systems can now dynamically adjust the granularity of knowledge graph retrieval, boosting performance by adapting to the complexity of user queries.
Large language models (LLMs) have recently been adopted for recommendations due to their ability to understand user intent and item semantics. However, LLM-based recommender systems often rely on parametric knowledge and suffer from outdated knowledge, motivating knowledge graph retrieval-augmented generation (KG-RAG) to ground recommendations on structured, up-to-date KGs. Despite this promise, effective KG-RAG in recommendations faces great challenges. First, users' queries vary in complexity and require KG knowledge at different granularities, whereas existing methods adopt a one-size-fits-all retrieval strategy, leading to over-retrieval for simple queries and under-retrieval for complex ones. In addition, augmenting LLMs with KG knowledge requires translating graph-structured data into linear text, which may introduce noise and cause structural information loss. Moreover, the selection of retrieval granularity lacks direct supervision and must be inferred from the final recommendation after alignment and downstream utilization, making query-aware retrieval hard to learn end-to-end. To address these issues, we propose MixRAGRec, a cooperative multi-agent framework for KG-RAG recommendations. MixRAGRec integrates a Mixture-of-Experts Retrieval Agent that routes each query to a KG retrieval expert with different granularities, a Knowledge Preference Alignment Agent that converts structured knowledge into LLM-friendly natural language, and a Contrastive Learning-reinforced Recommendation Agent trained with contrastive preference feedback. Notably, we introduce Mixture-of-Experts Multi-Agent Policy Optimization (MMAPO) to train three agents under a unified objective. Extensive experiments on real-world datasets demonstrate the effectiveness of our framework.
NUS