Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a Siamese LLM dual-encoder for semantic retrieval in e-commerce, designed to effectively manage the challenges posed by short, noisy queries over extensive product catalogs. By employing a two-stage training pipeline that includes contrastive learning with a false-negative margin mask and a novel preference optimization objective called Relative Odds Alignment for Retrieval (ROAR), the model achieves superior accuracy in retrieving exact matches and ranking substitutes and complementary products. The system's effectiveness is validated through live A/B testing, demonstrating significant performance improvements across various query frequencies and business verticals.
A novel dual-encoder model not only retrieves exact product matches but also optimally ranks substitutes and complementary items, transforming e-commerce search dynamics.
Semantic retrieval in e-commerce must handle short, noisy, and colloquial queries over large product catalogs with fine-grained attribute distinctions. We present a Siamese LLM dual-encoder trained through a two-stage pipeline: contrastive learning with a false-negative margin mask to prevent penalization of near-duplicate products, followed by Relative Odds Alignment for Retrieval (ROAR), a preference optimization objective that extends Bradley-Terry to variable-sized graded relevance groups via consecutive odds-ratio margins. The training corpus mirrors this progression - substitute query-product pairs provide coarse semantic supervision in Stage 1 and graded relevance annotations drive fine-grained ranking in Stage 2. The resulting system accurately retrieves exact matches while correctly ordering substitutes and complementary products, with gains confirmed across query-frequency strata and business verticals, and statistical significance validated through live A/B deployment at scale.