Search papers, labs, and topics across Lattice.
This paper introduces STEC, an evidence compression framework designed to enhance final answer selection in open-domain multi-hop question answering (QA) by addressing the challenges posed by multiple search trajectories. By employing Answer-Level Evidence Compression and Evidence-Guided Answer Verification, STEC effectively organizes and compares candidate-specific evidence, leading to improved selection accuracy. Experimental evaluations across four benchmarks demonstrate that STEC outperforms existing methods, highlighting the significance of structured evidence comparison in multi-hop QA tasks.
Final answer selection in multi-hop QA can be revolutionized by shifting from raw trajectory comparison to structured candidate-level evidence evaluation.
In open-domain multi-hop question answering (QA), LLM-based search agents offer a promising approach to knowledge-intensive QA by combining retrieval with reasoning. Existing methods mainly improve open-domain multi-hop QA through reasoning paradigms, retrieval interaction, and search strategy optimization. However, using multiple search trajectories introduces a challenging final answer selection problem. Different trajectories may support different candidates, and the retrieved information can be heterogeneous, redundant, incomplete, or conflicting. Directly comparing raw trajectories exposes the verifier to noisy and unaligned content, while comparing answer strings ignores the evidence supporting each candidate, making reliable final selection difficult. To address this challenge, we propose STEC, an evidence compression framework for final answer selection in multi-hop QA. STEC selects the final answer from the existing candidate set through two mechanisms: (1) Answer-Level Evidence Compression, which groups trajectories by normalized answer identity and converts each answer group into a candidate-specific evidence representation; and (2) Evidence-Guided Answer Verification, which compares these representations and selects the final answer from the candidate set. The design shifts final selection from raw trajectory comparison to candidate-level evidence comparison. We evaluate STEC on four open-domain multi-hop QA benchmarks against representative baselines. Experimental results show that STEC performs best overall among the compared methods, and ablation results provide evidence that answer-level evidence compression contributes to final answer selection.
