Search papers, labs, and topics across Lattice.
The paper introduces Multi-Probe Zero Collision Hash (MPZCH), a novel hash-based indexing mechanism for large-scale recommender systems that uses linear probing with auxiliary tensors and CUDA kernels to eliminate embedding collisions. MPZCH addresses the problem of performance degradation and stale embedding inheritance caused by collisions in traditional hash-based embedding tables as the volume of unique IDs increases. Online experiments demonstrate that MPZCH achieves zero collisions for user embeddings, improves item embedding freshness and quality, and maintains training QPS and inference latency comparable to existing methods.
Achieve zero-collision embedding tables in production recommenders without sacrificing training speed, unlocking better personalization via fresher and higher-quality item embeddings.
Embedding tables are critical components of large-scale recommendation systems, facilitating the efficient mapping of high-cardinality categorical features into dense vector representations. However, as the volume of unique IDs expands, traditional hash-based indexing methods suffer from collisions that degrade model performance and personalization quality. We present Multi-Probe Zero Collision Hash (MPZCH), a novel indexing mechanism based on linear probing that effectively mitigates embedding collisions. With reasonable table sizing, it often eliminates these collisions entirely while maintaining production-scale efficiency. MPZCH utilizes auxiliary tensors and high-performance CUDA kernels to implement configurable probing and active eviction policies. By retiring obsolete IDs and resetting reassigned slots, MPZCH prevents the stale embedding inheritance typical of hash-based methods, ensuring new features learn effectively from scratch. Despite its collision-mitigation overhead, the system maintains training QPS and inference latency comparable to existing methods. Rigorous online experiments demonstrate that MPZCH achieves zero collisions for user embeddings and significantly improves item embedding freshness and quality. The solution has been released within the open-source TorchRec library for the broader community.
Meta AI
OpenAI