Search papers, labs, and topics across Lattice.
This paper investigates the allocation of latent refinement steps in semantic ID-based generative recommendation systems, focusing on optimizing the use of these steps based on position-wise information gain (IG). By analyzing how different semantic ID positions contribute to the prediction of target items, the authors find that earlier positions generally provide more significant information gain, which informs their proposed Information-Gain Budget Allocation (IBA) framework. Experimental results demonstrate that IBA enhances the accuracy and efficiency of generative recommendation models compared to traditional fixed allocation methods.
Allocating latent refinement steps based on information gain can significantly boost generative recommendation accuracy while optimizing computational resources.
Semantic ID-based generative recommendation predicts an item by generating a short sequence of semantic ID tokens, where each token is produced autoregressively. Latent reasoning has recently been introduced to improve this process through additional hidden-state computation before each token decision. This raises a practical question: when one item is represented by a sequence of semantic ID tokens, should each token receive the same fixed number of latent refinement steps, or should these steps be allocated more effectively across positions? We study this question through position-wise information-gain (IG), which measures how much each semantic ID position reduces the uncertainty of the target item. We observe that earlier semantic ID positions usually provide higher information-gain, while later positions contribute less additional information. We further analyze that applying more refinement to high-IG positions tends to bring larger expected benefits. Based on this observation, we propose IBA, an Information-Gain Budget Allocation framework for semantic ID-based generative recommendation. IBA treats latent refinement steps as a limited computational resource and learns how to allocate them across semantic ID positions, assigning more refinement to informative positions and less to positions with smaller contribution. Experiments on multiple public datasets show that IBA consistently improves strong generative recommendation baselines and achieves a better accuracy--computation trade-off than fixed or poorly matched step allocations.
