Search papers, labs, and topics across Lattice.
This paper details a novel multi-turn retrieval-augmented generation (RAG) pipeline designed for the SemEval-2026 Task 8, which assesses conversational systems in diverse domains. By employing learned sparse retrieval as the primary method and leveraging the long-context capabilities of large language models (LLMs) for query rewriting and reranking, the authors enhance the system's ability to handle unanswerable queries and maintain conversational context. The results demonstrate improved robustness and performance across the evaluated domains, highlighting the effectiveness of integrating multi-step processes in conversational AI.
Sparse retrieval combined with LLM-based reranking transforms how conversational systems tackle unanswerable queries across multiple domains.
This report describes our participation in SemEval-2026 Task 8 on multi-turn retrieval and question answering. The task evaluates conversational systems across four domains (finance, cloud documentation, government, Wikipedia), and includes unanswerable queries where the available collection does not contain sufficient evidence to produce a complete response. We propose a multi-turn retrieval-augmented generation pipeline that combines learned sparse retrieval with LLM-based reranking and generation. Using sparse retrieval as the primary retrieval method, we leverage its strong generalization across domains. In addition, we make use of the long-context capabilities of LLMs for conversational query rewriting, pointwise and listwise reranking, and generating the final response, each conditioned on the full conversational history. This multi-step design enables effective integration of conversational context throughout retrieval and generation, improving robustness across domains.