Search papers, labs, and topics across Lattice.
This paper introduces a set-level retrieval framework that addresses the limitations of traditional passage scoring methods in multi-hop question answering by focusing on the compatibility among evidence passages. By formulating the retrieval task as query-set compatibility scoring, the authors train retrievers to prioritize complete and compatible evidence sets, which enhances robustness against noisy contexts. Experimental results demonstrate that their approach, utilizing both a lightweight late-interaction scorer (ParaSet) and a cross-encoder reranker (SetCE), significantly improves retrieval and downstream QA performance compared to conventional document-level methods.
Set-level compatibility learning not only boosts retrieval accuracy but also reveals that combining outputs from diverse retrievers outperforms traditional single-document approaches.
Multi-hop question answering and retrieval-augmented reasoning require selecting evidence passages that are jointly useful for answering a query. However, most retrievers still score passages independently or make locally supervised sequential decisions, which can fail when evidence usefulness depends on compatibility among passages. LLM-based set selection can model such interactions, but its computational cost limits practical use. We address this gap by formulating multi-hop retrieval as query-set compatibility scoring and propose a set-level retrieval framework. Our training objective teaches retrievers to rank complete and compatible evidence sets above incomplete, noisy alternatives, making set scoring more robust to variable-length and partially noisy contexts. We instantiate the framework with two complementary set scorers: ParaSet, a lightweight late-interaction scorer that applies self-attention over precomputed bi-encoder embeddings for fast candidate-set exploration, and SetCE, a cross-encoder-based reranker trained with the same set-level objective. Experiments on various multi-hop QA benchmarks show that set-level compatibility learning improves retrieval performance and downstream QA task performance. We further show that the proposed set-level retrievers not only outperform document-level retrievers, but also exhibit complementary retrieval characteristics: combining their outputs yields stronger performance than simply retrieving more passages from a single document-level retriever.
