Search papers, labs, and topics across Lattice.
This paper introduces Decoupled Search Grounding (DSG), a vendor-agnostic architecture that separates the search process from the reasoning model in large language model (LLM) agents, addressing issues of inspection, tuning, and cost efficiency. By implementing a multi-channel processing (MCP) compatible gateway, DSG allows for enhanced control over retrieval policy and context rendering, significantly reducing search costs while maintaining competitive accuracy. The results show that DSG achieves nearly equivalent accuracy to native search on SimpleQA with a remarkable 91% reduction in search costs and improved latency, making it a viable solution for large-scale agentic workloads.
DSG achieves 91% lower search costs while maintaining competitive accuracy, revolutionizing how LLM agents handle real-time search and reasoning.
Production LLM agents increasingly depend on real-time search, yet native search grounding bundles retrieval policy, provider choice, evidence injection, cost, latency, and generation behavior behind a single model-provider boundary. This coupling makes grounding hard to inspect, tune, reuse, or port, and can trigger Search-Induced Verbosity that breaks strict output contracts. We present Decoupled Search Grounding (DSG), a vendor-agnostic boundary that moves grounding outside the reasoning model through an MCP-compatible gateway, exposing provider routing, source-aware context rendering, configured fallback, retrieval-depth control, and exact plus semantic caching as first-class controls. Across five frontier models on SimpleQA, FreshQA, and HotpotQA, native search leads on recency-sensitive FreshQA, but DSG exposes a stronger frontier when control matters: on SimpleQA it nearly matches native accuracy (86.1% vs. 87.7%) at 91% lower search cost, preserves concise answer contracts, and reaches a 99.4% warm-cache hit rate with 68% lower latency. Deployed as a shared production grounding layer for large-scale agentic workloads with interchangeable models, DSG matches or slightly exceeds native-search accuracy on an e-commerce query-understanding (QIU) workload while cutting search cost by over 98%. Real-time grounding is best treated as an optimizable interface boundary, not a fixed model feature.
