Search papers, labs, and topics across Lattice.
The paper introduces ULTRA-HSTU, a sequential recommendation model designed with end-to-end model and system co-design to improve both model quality and efficiency in large-scale recommender systems. ULTRA-HSTU innovates on input sequence design, sparse attention mechanisms, and model topology to overcome the limitations of cross-attention-heavy approaches. Benchmarking shows ULTRA-HSTU achieves over 5x faster training and 21x faster inference scaling, leading to 4-8% improvements in consumption and engagement in a real-world production environment serving billions of users.
Forget quadratic complexity: ULTRA-HSTU achieves 21x faster inference and 4-8% better engagement in large-scale recommendation by co-designing input sequences, sparse attention, and model topology.
Learning from user interaction history through sequential models has become a cornerstone of large-scale recommender systems. Recent advances in large language models have revealed promising scaling laws, sparking a surge of research into long-sequence modeling and deeper architectures for recommendation tasks. However, many recent approaches rely heavily on cross-attention mechanisms to address the quadratic computational bottleneck in sequential modeling, which can limit the representational power gained from self-attention. We present ULTRA-HSTU, a novel sequential recommendation model developed through end-to-end model and system co-design. By innovating in the design of input sequences, sparse attention mechanisms, and model topology, ULTRA-HSTU achieves substantial improvements in both model quality and efficiency. Comprehensive benchmarking demonstrates that ULTRA-HSTU achieves remarkable scaling efficiency gains -- over 5x faster training scaling and 21x faster inference scaling compared to conventional models -- while delivering superior recommendation quality. Our solution is fully deployed at scale, serving billions of users daily and driving significant 4% to 8% consumption and engagement improvements in real-world production environments.
Meta AI