Search papers, labs, and topics across Lattice.
This paper introduces OneShot, a novel retrieval framework that aligns index learning with ranking objectives to enhance the efficiency and accuracy of recommendation systems. By employing a holistic approach that integrates neural scoring and interaction modeling, OneShot overcomes the traditional limitations of dot-product methods, resulting in significant improvements in retrieval performance. Deployed in Instagram's recommendation system, OneShot achieved a 20% recall gain and a 10x efficiency improvement, leading to increased user engagement and session duration.
OneShot redefines retrieval efficiency by achieving a 20% recall gain while enhancing user engagement metrics in Instagram's recommendation system.
In modern recommendation systems, retrieval serves as a primary stage responsible for filtering billions of candidate items down to thousands prior to refined ranking. To make this massive search effective and efficient, the system relies on ranking accuracy and indexing efficiency. However, these two objectives are traditionally misaligned: while the former optimizes for the alignment between ranking predictions and user behavior, the latter optimizes for a structural grouping of item representations which enables fast search among billions of candidates. Thus, despite extensive efforts to scale up interaction modeling for retrieval, they remain fundamentally limited by the structural misalignment between the ranking objectives and the proximity-learned index. In this work, we address this long-standing dichotomy by proposing a new holistic retrieval framework, OneShot. It is an end-to-end, in-model index learning framework that natively aligns index learning with ranking objectives. Using this joint learning as a structural foundation, OneShot pushes the boundaries of retrieval expressiveness by scaling interaction modeling with neural scoring beyond the persistent dot-product bottleneck. OneShot is fully deployed in Instagram's industrial short-video recommendation system, driving significant wins in user daily sessions, engagement, and time-spent. Additionally, OneShot achieves a $20\%$ recall gain at the operational ranking volume and a 10x efficiency improvement at an equivalent recall level.