Search papers, labs, and topics across Lattice.
This paper introduces DART (Dense Adaptive Reranking at Test-time), a novel approach that enhances the reranking of dense retrieval systems in zero-resource settings by adapting the scoring function during inference. By utilizing top-ranked documents as pseudo-positive examples and bottom-ranked documents as pseudo-negative examples, DART effectively trains a bilinear scoring matrix with minimal gradient updates. The method achieves a mean relative NDCG@10 gain of +2.1% across six BEIR benchmarks, all while maintaining low latency, showcasing its potential for improving zero-shot retrieval performance and generalization across domains.
DART boosts dense retrieval reranking performance by adapting scoring functions on-the-fly, achieving significant gains without the need for extensive training data.
Dense retrievers excel at first-stage candidate generation but lack effective reranking in zero-resource settings. Existing approaches face a fundamental dilemma: cross-encoders deliver strong reranking quality but require costly supervised training and incur high latency, while unsupervised BM25 reranking consistently degrades dense retrieval performance on most of BEIR benchmarks. We propose DART (Dense Adaptive Reranking at Test-time), which resolves this dilemma by adapting the scoring function at inference time. For each query, the top-ranked documents serve as pseudo-positive examples and the bottom-ranked as pseudo-negative examples, providing noisy but readily available supervision to adapt a bilinear scoring matrix $W$ via a small number of gradient updates. We further introduce a confidence-weighted margin loss and a cross-query momentum buffer that warm-starts adaptation across queries. On six BEIR benchmarks, DART achieves a mean per-dataset relative NDCG@10 gain of +2.1% over the dense retrieval baseline with under 10ms additional latency per query, demonstrating a powerful capability for zero-shot performance enhancement and cross-domain generalization.
