Search papers, labs, and topics across Lattice.
The paper introduces KnowSA_CKP, a novel method to address the knowledge gap problem in LLM-based recommenders, where uneven item knowledge hinders performance. KnowSA_CKP selectively augments the input prompt with external information only for items where the LLM's internal knowledge is deemed insufficient, as determined by a comparative knowledge probing technique. Experiments on four real-world datasets demonstrate that KnowSA_CKP improves both recommendation accuracy and context efficiency by strategically allocating the context budget.
LLMs waste context on redundant information when making recommendations; selectively augmenting only lesser-known items boosts accuracy and efficiency.
Large language models (LLMs) have recently emerged as powerful training-free recommenders. However, their knowledge of individual items is inevitably uneven due to imbalanced information exposure during pretraining, a phenomenon we refer to as knowledge gap problem. To address this, most prior methods have employed a naive uniform augmentation that appends external information for every item in the input prompt. However, this approach not only wastes limited context budget on redundant augmentation for well-known items but can also hinder the model's effective reasoning. To this end, we propose KnowSA_CKP (Knowledge-aware Selective Augmentation with Comparative Knowledge Probing) to mitigate the knowledge gap problem. KnowSA_CKP estimates the LLM's internal knowledge by evaluating its capability to capture collaborative relationships and selectively injects additional information only where it is most needed. By avoiding unnecessary augmentation for well-known items, KnowSA_CKP focuses on items that benefit most from knowledge supplementation, thereby making more effective use of the context budget. KnowSA_CKP requires no fine-tuning step, and consistently improves both recommendation accuracy and context efficiency across four real-world datasets.
