Search papers, labs, and topics across Lattice.
This paper introduces CORE, a unified cascaded binary classification framework that reformulates e-commerce search relevance estimation as a sequential decision process, addressing the shortcomings of traditional multi-class classification methods. By employing a step-wise reasoning procedure for large language models and implementing tier-specific binary classifiers for online BERT inference, the framework effectively captures the ordinal nature of relevance levels. Extensive evaluations reveal a significant 15.94% reduction in the online bad-case rate, highlighting the effectiveness of tier-wise modeling in improving relevance performance.
Relevance estimation in e-commerce can be dramatically improved by treating it as a sequential decision process, leading to a 15.94% reduction in bad-case rates.
Ranking relevance is a fundamental task in e-commerce search, directly affecting ranking quality and consumer experience. Although inherently an ordinal classification problem, it is commonly formulated as conventional multi-class classification, which overlooks the natural order among relevance levels and assigns equal penalties to adjacent and distant misclassifications. This mismatch leads to suboptimal learning objectives for practical relevance evaluation. To address this issue, we propose a unified cascaded binary classification framework applicable to both large language model inference and online BERT-based inference, which reformulates relevance estimation as a sequential decision process and decomposes multi-class prediction into a series of ordered binary judgments from higher to lower relevance tiers. For large language models, we design a step-wise reasoning procedure with pruning strategies and tier-specific reward functions. For the online BERT model, we replace the conventional classification head with multiple level-wise binary classifiers and distill the capabilities of large language models into the online model. Extensive offline industrial benchmark evaluations and online A/B experiments demonstrate that the proposed framework substantially improves relevance performance, reducing the online bad-case rate by 15.94\%. Further analyses suggest that tier-wise modeling is effective for relevance estimation.
