Search papers, labs, and topics across Lattice.
This paper introduces Pair-Space Generation (PSG), a novel approach to generative reranking in recommender systems that shifts the focus from individual items to ordered item pairs, addressing the limitations of traditional Auto-Regressive methods. By operating over a pair vocabulary and generating only half the tokens, PSG significantly reduces computational complexity while maintaining expressiveness, achieving a theoretical speedup of 2x to 4x and a real-world improvement of 1.83x. The deployment of PSG on Kuaishou resulted in a measurable increase in user engagement, highlighting its practical effectiveness in large-scale applications.
Pair-Space Generation achieves up to 4x faster generative reranking while enhancing user engagement on platforms with over 400 million daily users.
Modern recommender systems adopt Generator-Evaluator (G-E) for list-wise reranking: a generator produces sequences from candidates and an evaluator scores them at sequence-level to filter out the optimal one for exposure. Auto-Regressive(AR), working as the backbone for generative recommendation, suffers two limitations. First, its complexity grows linearly with list length, forcing the system to generate fewer lists under rigorous latency constraints and thus limiting exploration. Second, teacher-forcing creates a train-test mismatch; cumulative errors worsen with length and degrade quality. To address these problems, we propose Pair-Space Generation (PSG), a reformulation that elevates the generation atom from individual items to ordered item pairs. Given $n$ candidate items, PSG operates over pair vocabulary of size $n(n-1)$ per request, generates only $L/2$ tokens. Pair token representations are produced on-the-fly by a pretrained pair-token representation module optimized over large scale exposure logs, eliminating the data sparsity that would otherwise plague a quadratic sized vocabulary. We establish three theoretical guarantees: (i) PSG is bijective with item-space generation and induces an equivalent family of sequence distributions, thus incurring no loss of expressiveness; (ii) generation in pair-token space achieves approximately a $2\times$ to $4\times$ speedup theoretically under moderate settings and $1.83\times$ in the real industrial environmental settings; and (iii) under outcome-only rewards, the worst-case suboptimality of PSG is bounded by $O((L/2)^2 \bar{\epsilon})$, representing a nearly $4\times$ improvement over item-space generation. Beyond benchmark-based validation, PSG has also been deployed on Kuaishou, delivering a 0.178\% lift in per-user stay time on the platform, which serves over 400 million daily active users.
