Search papers, labs, and topics across Lattice.
This paper introduces TALRanker, a novel framework that optimizes the reranking of documents in information retrieval by formalizing pointwise relevance scoring as a Markov decision process. By employing a two-stage training paradigm that combines a language-preserving hybrid loss and a cost-aware reinforcement learning reward, TALRanker effectively balances efficiency and accuracy, selectively invoking external tools only when necessary. The results show that TALRanker achieves state-of-the-art performance on various benchmarks, matching the throughput of traditional rerankers while outperforming larger reasoning models in accuracy.
TALRanker autonomously navigates the trade-off between efficiency and accuracy in document reranking, achieving state-of-the-art results without the latency of excessive tool calls.
Generative Large Language Models (LLMs) have revolutionized information retrieval, yet their strictly parametric nature frequently leads to severe factual hallucinations when confronted with complex queries beyond their epistemic boundaries. While external tool-calling can mitigate this, indiscriminately invoking search tools for every document during reranking incurs prohibitive latency overheads, creating an intractable accuracy-efficiency dilemma. To address this challenge, we propose TALRanker, a novel framework that formalizes pointwise relevance scoring as an agentic Markov decision process. We optimize it via a two-stage training paradigm. An initial warm-up utilizes a language-preserving hybrid loss to prevent the catastrophic forgetting of native generative capacities. Subsequently, an asymmetric cost-aware reward equipped in reinforcement learning forces the policy to autonomously bypass tools for maximum efficiency when confident, while selectively retrieving external evidence to avert severe hallucination penalties when uncertain. Extensive evaluations demonstrate that TALRanker achieves state-of-the-art performance across standard and reasoning-intensive retrieval benchmarks, matching throughput with pointwise rerankers while outperforming parameter-heavy reasoning models.
CMU ML