Search papers, labs, and topics across Lattice.
This paper identifies and addresses the pervasive issue of Length Bias in large language model (LLM)-based recommendation systems, where longer item descriptions receive disproportionate attention and negatively impact recommendation performance. The authors propose LBR (Length Bias Reduction), a lightweight, model-agnostic framework that employs Length-Aware Attention Calibration and Effective Information Length Normalization to mitigate this bias. Extensive experiments on Amazon datasets reveal that LBR significantly enhances recommendation accuracy and fairness, achieving an average NDCG@5 gain of 16.82% with minimal overhead.
Length Bias in LLM-based recommendations can be effectively mitigated, leading to a 16.82% improvement in accuracy and fairness without significant computational costs.
Large language models (LLMs) have recently emerged as powerful backbones for recommender systems by reformulating recommendation as a token-level generation task. Despite their promise, we identify a pervasive yet underexplored issue: $\textit{Length Bias}$. Because items are represented by textual descriptions of varying lengths, LLM-based recommenders can be systematically biased in two ways. On the input side, longer item descriptions occupy more tokens in the context and thus receive disproportionately large aggregate attention mass during user preference modeling. On the output side, decoding based on summed autoregressive log-likelihood score inherently disfavors long items. Worse still, conventional length normalization can introduce an additional bias and even degrade recommendation performance. To address this problem, we propose $\textbf{LBR}$ ($\textbf{L}$ength $\textbf{B}$ias $\textbf{R}$eduction), a lightweight and model-agnostic framework for mitigating length bias in LLM-based recommendation. LBR mitigates input-side bias via Length-Aware Attention Calibration, which incorporates a length-dependent offset into attention logits to neutralize attention skew. For the output side, LBR introduces Effective Information Length Normalization, replacing naive token count with an information-theoretic length surrogate derived from the branching structure of the prefix tree. Extensive experiments on three real-world Amazon datasets and two representative LLM-based recommenders demonstrate that LBR substantially alleviates length bias while consistently improving recommendation accuracy and fairness, with negligible additional training and inference overhead (with an average NDCG@5 gain of 16.82%). The code is available at https://github.com/Void-JackLee/LBR.
