Search papers, labs, and topics across Lattice.
This paper introduces Agent-UCT, a novel tree search algorithm that enhances Upper Confidence Bounds for optimizing agentic workflows by incorporating a reuse-aware regularization term derived from a bipartite prefix reuse graph. By systematically unifying various retrieval-augmented generation (RAG) components into a five-dimensional configuration space, the method effectively reduces redundant computations and improves budget allocation. Experimental results on HotpotQA and UltraDomain show that Agent-UCT can reduce logical search costs by 73.6% and achieve a 4.2x speedup in wall-clock time compared to traditional sampling-based evaluations.
Agent-UCT slashes logical search costs by over 73% while optimizing agentic workflows, making it a game-changer for RAG pipelines.
Optimizing agentic workflows, such as retrieval-augmented generation (RAG) pipelines, requires navigating a combinatorial space of discrete component choices under tight evaluation budgets. Existing approaches - heuristic search, black-box optimization, and standard tree search methods - do not explicitly exploit the compositional structure of these workflows, leading to redundant computation and inefficient budget allocation. We introduce Agent-UCT (Agent-based Cost-Aware Upper Confidence Bounds Applied to Trees), a tree search algorithm that extends UCT with a reuse-aware regularization term derived from a bipartite prefix reuse graph. Agent-UCT biases selection toward branches that leverage previously materialized configuration prefixes, reducing redundant execution while maintaining effective exploration. Our framework, RAGSpace, unifies heterogeneous RAG components from LongRAG, LightRAG, and Self-RAG into a five-dimensional configuration space, enabling systematic cross-framework recombination. WTB (Workflow Test Bench) provides deterministic replay, content-addressable caching, and transactional consistency, ensuring that intermediate states are materialized once and reused across the search. Experiments on HotpotQA and UltraDomain demonstrate that Agent-UCT identifies configurations with the highest out-of-sample performance among the evaluated fixed framework presets. Under full-pool evaluation, bipartite prefix reuse reduces logical search cost by 73.6% relative to the no-prefix-sharing cost upper bound. Compared with full-pool evaluation, sampling-based evaluation further achieves a 4.2x wall-clock speedup. Agent-UCT, RAGSpace, and WTB together provide a unified framework for cost-aware, reproducible, and compositionally efficient agentic workflow optimization.
