Search papers, labs, and topics across Lattice.
This paper investigates the memorization behavior of large language models (LLMs) in generative recommendation systems, revealing that LLMs tend to rely heavily on one-hop memorization, which limits their ability to generalize beyond training data. The authors introduce a novel training strategy, IIRG, that enhances LLMs' performance by enabling them to learn richer item-item relationships through collaborative and semantic relations. The results demonstrate that IIRG significantly improves recommendation accuracy, particularly for users whose target items cannot be predicted through one-hop transitions, highlighting the importance of addressing memorization in LLMs for effective generative recommendation.
LLMs excel in generative recommendation but often fall back on one-hop memorization, risking their potential to generalize effectively.
Generative recommendation (GR) has emerged as a promising direction for recommender systems. Recently, large language models (LLMs) have been increasingly adopted for GR, as their rich pretrained knowledge is expected to help them generalize beyond common user behavior patterns that traditional memorization-oriented baselines can capture. However, existing LLM-based GR works largely ignore LLMs' well-known tendency to memorize, which, if present in LLMs fine-tuned for GR, would restrict their utilization of pretrained knowledge. In this work, we investigate this concern by examining one-hop memorization, where a model recommends items that are direct successors of items in the training data. We show that LLMs do this more than non-LLM-based GR models-in fact, the vast majority of their gains over GR baselines are actually on users whose target items can be predicted through one-hop memorization. We intuit that improving performance on the remaining users requires LLMs to learn richer item-item relations beyond one-hop transitions. To achieve this, we propose IIRG, a novel training strategy that teaches LLMs to capture: (1) collaborative relations derived from item co-occurrences across multiple hops in user sequences, and (2) semantic relations among items with similar themes, both of which can serve as useful recommendation signals. We show that IIRG significantly improves over LLMs trained solely with standard next-item prediction, with especially large gains for users whose test items are not covered by train-time one-hop transitions.
