Search papers, labs, and topics across Lattice.
Gryphon is a novel encoder-decoder architecture for generative retrieval that integrates item-level scoring with Semantic ID generation to enhance the relevance of recommendations. By directly scoring items rather than relying on beam search likelihood, Gryphon effectively mitigates issues of miscalibration and item collisions, resulting in improved recommendation accuracy. In a real-world application on an industrial music service, Gryphon achieved a 3.7% increase in Recall@1000 over traditional generative retrieval methods while simplifying the candidate generation process without compromising user engagement metrics.
Gryphon outperforms traditional generative retrieval by directly scoring items, leading to a significant boost in recommendation relevance and accuracy.
Generative retrieval (GR) has become a scalable approach to candidate generation: each item is assigned a short hierarchical token sequence called a Semantic ID (SID), and the next item's SID is decoded autoregressively. A practical limitation is that the decoder's beam search optimizes the likelihood of token sequences, not the relevance of the underlying items. These objectives diverge when sequence likelihood is poorly calibrated due to beam search error accumulation, and when several items collapse onto a single SID and receive identical scores. We introduce Gryphon, an encoder-decoder generative recommendation architecture that adds a jointly trained item-level scoring component alongside SID generation, reusing the encoder's user representation computed in a single forward pass. Instead of ranking SIDs by accumulated token likelihood, Gryphon resolves each generated SID to its concrete items and re-scores those items directly, which sidesteps miscalibrated sequence scores and separates items that collide on the same identifier. On an industrial music service, with item-level scoring trained under a next-item-prediction objective, Gryphon attains the highest item-level Recall@1000, above the strongest baselines (+3.7% over vanilla GR and +2.5% over collision-resolved GR) at comparable parameter count and latency. Gryphon's item-level ranking also surpasses its beam-likelihood ranking of the same candidates (+4.2% gain), demonstrating the benefit of item-level scoring in GR. Deployed as the sole candidate source in a 7-day A/B test, Gryphon produced no statistically significant change in total listening time (+0.25%) while replacing a pipeline of more than 15 candidate generators and a separate preranking stage, substantially simplifying the candidate-generation system.
