Search papers, labs, and topics across Lattice.
This paper explores the application of Semantic IDs (SIDs), which are tokenized semantic representations of items, within recommender systems at Snapchat. They address challenges in applying SIDs, such as cardinality management and feature interaction, through careful design choices and experimentation. Results from offline evaluations and online A/B tests demonstrate that SIDs improve ranking and retrieval performance, leading to their deployment in production models.
Semantic IDs, which drastically reduce ID cardinality while inducing semantic clustering, have demonstrably improved ranking and retrieval in Snapchat's production recommender systems.
Effective item identifiers (IDs) are an important component for recommender systems (RecSys) in practice, and are commonly adopted in many use cases such as retrieval and ranking. IDs can encode collaborative filtering signals within training data, such that RecSys models can extrapolate during the inference and personalize the prediction based on users' behavioral histories. Recently, Semantic IDs (SIDs) have become a trending paradigm for RecSys. In comparison to the conventional atomic ID, an SID is an ordered list of codes, derived from tokenizers such as residual quantization, applied to semantic representations commonly extracted from foundation models or collaborative signals. SIDs have drastically smaller cardinality than the atomic counterpart, and induce semantic clustering in the ID space. At Snapchat, we apply SIDs as auxiliary features for ranking models, and also explore SIDs as additional retrieval sources in different ML applications. In this paper, we discuss practical technical challenges we encountered while applying SIDs, experiments we have conducted, and design choices we have iterated to mitigate these challenges. Backed by promising offline results on both internal data and academic benchmarks as well as online A/B studies, SID variants have been launched in multiple production models with positive metrics impact.
