Search papers, labs, and topics across Lattice.
This paper introduces a scalable system for enhancing item discoverability in e-commerce search by utilizing intent-conditioned recall expansion, addressing the limitations of traditional search systems that prioritize precision over recall. By employing a two-stage hybrid architecture that combines closed-weight large language models (LLMs) for head queries and a finetuned small language model (SLM) for tail queries, the authors achieve significant improvements in both intent generation quality and retrieval effectiveness. The results indicate that their approach increases discovery coverage from 60% to 80% of query traffic while reducing inference costs to about 30% of the teacher model's expenses, making it a promising solution for large-scale marketplaces.
Expanding item discoverability in e-commerce search can boost query coverage from 60% to 80% while slashing inference costs to a third of traditional models.
Traditional search systems are optimized to retrieve items that strictly match a query, often prioritizing precision over recall. In e-commerce marketplaces and particularly grocery, this paradigm is limiting, as user satisfaction and commercial outcomes depend heavily on the discoverability of substitute, complementary, and thematically related items. In this paper, we present a scalable system for discovery-augmented search that leverages intent-conditioned recall expansion. Our approach generates implicit user intents to expand candidate recall while maintaining relevance. The system addresses the cost-quality tradeoff of generative retrieval through a two-stage hybrid architecture. First, we leverage closed-weight large language models (LLMs) to maximize discoverability for head queries. To extend these benefits to tail queries, we then introduce a finetuned small language model (SLM), trained via LoRA adapters and teacher-student distillation. We evaluate the system using a rigorous dual framework: (a) LLM-as-a-judge metrics validated against human preferences for semantic quality, and (b) end-to-end session-level purchase analysis. Results demonstrate that our approach improves both intent generation quality and downstream retrieval effectiveness, extending discovery coverage from approximately 60% to 80% of query traffic at roughly 30% of the teacher model's inference cost, offering a viable path for deployment in large-scale marketplaces. Beyond relevance gains, discovery-augmented search may serve as a marketplace-balancing mechanism, giving long-tail and emerging supply an opportunity for query-conditioned exposure.
