Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces LAnR (Latent Abstraction for RAG), a novel framework that integrates encoding, retrieval, and generation within a single large language model (LLM) by utilizing dense retrieval vectors derived from hidden states. By eliminating the need for separate retrievers and textual queries, LAnR enhances the efficiency of retrieval-augmented generation while maintaining high factual accuracy. Experimental results across six QA benchmarks indicate that LAnR not only outperforms traditional RAG methods but also reduces the number of retrieval calls, demonstrating significant improvements in inference efficiency.
LAnR achieves superior performance in retrieval-augmented generation by seamlessly integrating retrieval and generation processes within a single LLM, leading to enhanced efficiency and accuracy.
Retrieval-Augmented Generation (RAG) has become a standard approach for enhancing large language models (LLMs) with external knowledge, mitigating hallucinations, and improving factuality. However, existing systems rely on generating natural language queries at each hop and maintaining a strict architectural separation between retriever and generator, preventing them from leveraging the full representational capacity of the LLM. We propose \textbf{LAnR} (Latent Abstraction for RAG), a unified framework in which a single LLM jointly performs encoding, retrieval, and generation entirely within its own latent space. Rather than generating textual queries, LAnR produces dense retrieval vectors from the hidden states of a designated \texttt{[PRED]} token and uses them to match against encoded document representations from the same model. Furthermore, LAnR adaptively decides when sufficient evidence has been retrieved using a lightweight MLP control head over those same hidden states, eliminating both the separate retriever and explicit token-level stopping reasoning. This design is motivated by our empirical observation that answer token entropy reliably signals retrieval sufficiency. Extensive experiments on six QA benchmarks spanning single-hop and multi-hop settings demonstrate that LAnR outperforms existing RAG methods, while achieving improved inference efficiency through reduced number of retrieval calls and tighter model integration.