Search papers, labs, and topics across Lattice.
NUSInformation and Communication BranchShanghai Dewu Information Group Co.Aug 3, 2026arXiv:2608.01738This paper introduces SPEAR, a novel framework that integrates query reformulation and retrieval in e-commerce search to address the misalignment between rewrite quality and retrieval effectiveness. By employing a dual-embedding backbone, a multiplicative gating aggregator, and a Dynamic Rewrite Selector, SPEAR significantly enhances the relevance of rewrites while maintaining user intent. The results demonstrate an 18.2% improvement in semantic similarity and a 99.5% increase in click recall, alongside substantial gains in user engagement metrics during online testing.
SPEAR achieves a staggering 99.5% increase in click recall by aligning query rewrites with user intent, transforming e-commerce search effectiveness.
Query reformulation bridges user intent and retrieval in e-commerce search, yet production systems optimize rewrite quality and retrieval effectiveness separately, leaving the two stages structurally misaligned. Path-based architectures unify them end-to-end but were designed for personalization, where relevance is not an explicit constraint-search additionally requires the rewrite to remain faithful to the user's stated query intent. Transplanted directly, these models learn a shortcut we term the generic-word dominance effect: they favor generic rewrites that score well on paths but drift from query intent. To address this, we propose SPEAR (Selection-aware Personalized End-to-end Adaptive Rewriting and Retrieval), which integrates three components that each target one failure mode: (1) a dual-embedding backbone with auxiliary loss and gradient isolation that shields recall-side semantics from being eroded by CTR-driven ranking signals; (2) a multiplicative gating aggregator that lets a rewrite score high only when both its confidence and item relevance are strong, eliminating the generic-word shortcut; (3) a Dynamic Rewrite Selector that jointly generates request-specific rewrite weights and user-query-conditioned scale and bias terms, allowing both rewrite preference and relevance calibration to adapt to each request. Offline evaluation on 100K held-out industrial search sessions shows that the proposed framework improves rewrite semantic similarity@10 by +18.2 and click recall@10 by +99.5 over the production baseline. In online A/B testing, SPEAR achieves +0.259 in query-view CTR and +0.733 in average reading depth, confirming that improved rewrite selection translates into stronger retrieval and deeper user engagement. The proposed SPEAR system has been fully deployed in Dewu's community search platform since 2025. Our code is available at https://github.com/mallocagi1-cell/spear.
