Search papers, labs, and topics across Lattice.
This paper introduces a metric-agnostic learning-to-rank (LTR) framework to address the limitations of existing LTR methods that are tied to specific ranking metrics. They propose a novel differentiable ranking loss function that combines a smooth approximation of the ranking operator with the average mean square loss per query. By adapting gradient-boosting machines to minimize this loss, the method achieves state-of-the-art performance across various information retrieval metrics with comparable efficiency.
Achieve state-of-the-art ranking performance across diverse metrics with a single model, sidestepping the need for metric-specific optimization.
Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant success in real-world information retrieval systems, current LTR methods rely on one prefix ranking metric (e.g., such as Normalized Discounted Cumulative Gain (NDCG) or Mean Average Precision (MAP)) for optimizing the ranking objective function. Such metric-dependent setting limits LTR methods from two perspectives: (1) non-differentiable problem: directly optimizing ranking functions over a given ranking metric is inherently non-smooth, making the training process unstable and inefficient; (2) limited ranking utility: optimizing over one single metric makes it difficult to generalize well to other ranking metrics of interest. To address the above issues, we propose a novel listwise LTR framework for efficient and generalizable ranking purpose. Specifically, we propose a new differentiable ranking loss that combines a smooth approximation to the ranking operator with the average mean square loss per query. Then, we adapt gradient-boosting machines to minimize our proposed loss with respect to each list, a novel contribution. Finally, extensive experimental results confirm that our method outperforms the current state-of-the-art in information retrieval measures with similar efficiency.
