Search papers, labs, and topics across Lattice.
This paper introduces SetMIR, a novel approach to multi-interest retrieval that frames the problem as set prediction, addressing limitations of existing methods such as interest collapse and static dispatch. By employing a transformer to encode user behavior and utilizing K learnable queries to decode distinct user interests, SetMIR effectively reduces redundancy in retrieval queries. The method demonstrates significant performance improvements on Snap's Dynamic Product Ads data, achieving a 3.1% lift in overall conversion rate (CVR) and a 44% increase in click-through rate (CTR) while issuing 33% fewer approximate nearest neighbor (ANN) queries.
SetMIR not only boosts conversion rates by over 3% but also streamlines retrieval by cutting down query redundancy by a third.
Embedding-based retrieval is at the core of industrial recommender systems, but a single user embedding is often too limited to capture a user's diverse interests. Multi-interest retrieval addresses this by using multiple user embeddings, yet existing methods still suffer from two issues: interest collapse, where different embeddings learn the same interest, and static dispatch, where serving uses a fixed retrieval budget even when some embeddings are unnecessary. We propose SetMIR, which treats multi-interest retrieval as a set prediction problem. SetMIR encodes a user's behavior history with a transformer and uses K learnable queries to decode a set of user interests, each producing a retrieval embedding and a presence score. During training, Hungarian matching assigns targets to queries one-to-one, so matched queries learn distinct interests and the presence head learns which queries are active. At serving time, SetMIR uses presence scores and query-level Non-Maximum Suppression (NMS) to issue only active, non-redundant ANN queries. On Snap's Dynamic Product Ads (DPA) data, SetMIR outperforms four learned multi-interest retrievers on every metric while issuing 33% fewer ANN queries per request. Deployed as a new retrieval source in the DPA production stack, SetMIR lifts overall CVR by 3.1%, while lifting CTR by 44% and CVR by 51% over the item-to-item retrieval source with the same item embeddings, ANN index, and retrieval quota.
