Search papers, labs, and topics across Lattice.
This paper introduces GALLM, a graph-aware large language model framework designed to enhance sequential recommendation systems by effectively capturing collaborative signals from user-item interactions. By constructing a collaborative graph that models Text--Text, Item--Text, and Item--Item relations, GALLM integrates these relationships into the LLM's attention mechanism without the need for an additional graph encoder. Experimental results demonstrate that GALLM outperforms existing methods, achieving an average improvement of 9.76% in HR@5 across four benchmark datasets.
GALLM redefines sequential recommendation by seamlessly integrating collaborative signals into LLMs, achieving significant performance gains without extra complexity.
Large language models (LLMs) have been widely adopted as backbones for recommender systems. However, their language-centric pretraining makes it difficult to capture collaborative signals implicit in user-item interactions, which are crucial for personalized recommendation. Existing methods either inject collaborative representations produced by external recommenders or model only intra-sequence dependencies, limiting their ability to exploit global collaborative patterns. To address this limitation, we propose GALLM, a graph-aware LLM framework for sequential recommendation. GALLM constructs a collaborative graph over text tokens and item tokens, and models three types of relations: Text--Text relations for preserving semantic dependencies, Item--Text relations for aligning item tokens with their textual descriptions, and Item--Item relations derived from global item co-occurrence patterns. These relations are transformed into lightweight learnable attention biases and incorporated into the LLM attention mechanism, enabling collaborative-aware token interactions without introducing an additional graph encoder. Experiments on four real-world benchmarks show that GALLM achieves the best performance among the compared baselines, improving over the strongest baseline by 9.76\% on average in HR@5.
