Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to generative retrieval in e-commerce by jointly training product embeddings and a codebook while leveraging same product cluster information as a supervisory signal. This method addresses the limitations of traditional two-stage training, particularly the error accumulation from biased embeddings and the lack of interaction modeling between queries and products. Experimental results show that this integrated approach significantly enhances retrieval performance and improves the consistency of product ID assignments within clusters.
Jointly training embeddings and codebooks while incorporating product cluster information leads to a dramatic boost in e-commerce retrieval accuracy.
With the development of large language models (LLMs), generative retrieval is becoming increasingly important in e-commerce scenarios. Current mainstream approaches typically use a two-stage training strategy: first train a product embedding model, and then learn a codebook that maps embeddings to product IDs. This cascaded approach suffers from two major issues: (1) error accumulation-if the embedding model in the first stage produces biased representations, the codebook in the second stage cannot correct these errors, degrading final retrieval performance; and (2) codebook learning relies solely on product embeddings and lacks modeling of query-to-product and product-to-product interactions. As a result, products belonging to the same cluster may be assigned inconsistent IDs by the codebook, further hurting retrieval accuracy. To address these problems, we propose a novel method that jointly trains the embedding model and the codebook, and incorporates same product cluster information as an additional supervision signal. Experimental results demonstrate that our method significantly improves e-commerce retrieval performance while simultaneously enhancing both embedding and codebook learning.
