Search papers, labs, and topics across Lattice.
This paper introduces a novel agentic RAG framework that leverages LLMs to formulate retrieval intents using logical expressions, paired with a simplified inverted-index-based retrieval backend. By delegating greater control to the LLM for query construction, the framework achieves performance comparable to agentic hybrid retrieval baselines while significantly reducing computational costs. Furthermore, the logical query structure demonstrably reduces hallucinations in the generated responses.
LLMs can drive agentic RAG to match the performance of complex hybrid retrieval systems, even with a simple inverted index, by expressing retrieval intents as logical expressions.
Recent advances in RAG have shifted toward an agentic paradigm, where LLMs interact with retrieval systems over multiple turns and iteratively refine queries based on intermediate results. At the same time, LLMs have demonstrated a strong ability to construct structured queries that precisely express their information needs. However, contemporary RAG systems remain heavily focused on engineering complex retrieval backends, including dense, hybrid, and graph-based retrieval architectures. In this study, we argue that agentic RAG should delegate greater control to the LLM to steer the retrieval process, while relying on a lightweight retrieval interface that provides fine-grained control and faithfully executes the LLM's structured intent. Guided by this principle, we propose an agentic RAG framework that enables LLMs to formulate retrieval intents using logical expressions while simplifying the retrieval backend to an inverted-index-based system. Extensive experiments show that our framework matches a strong agentic hybrid baseline, while substantially reducing construction and serving cost. Moreover, we show that anchoring the retrieval process in logical queries substantially reduces hallucinations in generated responses.
