Search papers, labs, and topics across Lattice.
This paper introduces a "Mine and Refine" contrastive learning framework to improve semantic text embeddings for multi-category e-commerce search retrieval, addressing the challenge of graded relevance and noisy queries. The framework uses a lightweight LLM fine-tuned on human annotations to generate scalable, policy-consistent supervision. The two-stage approach first trains a Siamese network with a label-aware contrastive objective, then refines the embedding space using hard sample mining, LLM re-annotation, and a multi-class circle loss to sharpen similarity boundaries between relevance levels.
Achieve statistically significant gains in e-commerce search relevance and business impact by explicitly modeling graded relevance levels during contrastive embedding training.
We propose a two-stage "Mine and Refine" contrastive training framework for semantic text embeddings to enhance multi-category e-commerce search retrieval. Large scale e-commerce search demands embeddings that generalize to long tail, noisy queries while adhering to scalable supervision compatible with product and policy constraints. A practical challenge is that relevance is often graded: users accept substitutes or complements beyond exact matches, and production systems benefit from clear separation of similarity scores across these relevance strata for stable hybrid blending and thresholding. To obtain scalable policy consistent supervision, we fine-tune a lightweight LLM on human annotations under a three-level relevance guideline and further reduce residual noise via engagement driven auditing. In Stage 1, we train a multilingual Siamese two-tower retriever with a label aware supervised contrastive objective that shapes a robust global semantic space. In Stage 2, we mine hard samples via ANN and re-annotate them with the policy aligned LLM, and introduce a multi-class extension of circle loss that explicitly sharpens similarity boundaries between relevance levels, to further refine and enrich the embedding space. Robustness is additionally improved through additive spelling augmentation and synthetic query generation. Extensive offline evaluations and production A/B tests show that our framework improves retrieval relevance and delivers statistically significant gains in engagement and business impact.
