Search papers, labs, and topics across Lattice.
This paper introduces HaS, a homology-aware speculative retrieval framework for RAG that accelerates retrieval by first performing low-latency speculative retrieval over restricted scopes to obtain candidate documents, then validating whether they contain the required knowledge. Validation is done by formulating a homologous query re-identification task, where previously observed queries are identified as homologous re-encounters of the incoming query, allowing the system to bypass slow full-database retrieval. Experiments show HaS reduces retrieval latency by 23.74% and 36.99% with minimal accuracy loss, and also accelerates multi-hop queries in agentic RAG pipelines.
Speed up your RAG pipelines by up to 37% without sacrificing accuracy by speculatively retrieving documents based on query homology.
Retrieval-Augmented Generation (RAG) expands the knowledge boundary of large language models (LLMs) at inference by retrieving external documents as context. However, retrieval becomes increasingly time-consuming as the knowledge databases grow in size. Existing acceleration strategies either compromise accuracy through approximate retrieval, or achieve marginal gains by reusing results of strictly identical queries. We propose HaS, a homology-aware speculative retrieval framework that performs low-latency speculative retrieval over restricted scopes to obtain candidate documents, followed by validating whether they contain the required knowledge. The validation, grounded in the homology relation between queries, is formulated as a homologous query re-identification task: once a previously observed query is identified as a homologous re-encounter of the incoming query, the draft is deemed acceptable, allowing the system to bypass slow full-database retrieval. Benefiting from the prevalence of homologous queries under real-world popularity patterns, HaS achieves substantial efficiency gains. Extensive experiments demonstrate that HaS reduces retrieval latency by 23.74% and 36.99% across datasets with only a 1-2% marginal accuracy drop. As a plug-and-play solution, HaS also significantly accelerates complex multi-hop queries in modern agentic RAG pipelines. Source code is available at: https://github.com/ErrEqualsNil/HaS.
