Search papers, labs, and topics across Lattice.
EvoTool is introduced as a self-evolving framework for optimizing modular tool-use policies in LLM agents by decomposing the policy into Planner, Selector, Caller, and Synthesizer modules. The framework iteratively improves these modules using Trajectory-Grounded Blame Attribution to localize failures, Feedback-Guided Targeted Mutation to edit specific modules, and Diversity-Aware Population Selection to maintain solution diversity. Experiments across four benchmarks demonstrate that EvoTool outperforms strong baselines on both GPT-4.1 and Qwen3-8B in terms of performance, efficiency, and transferability.
LLM agents can now evolve better tool-use policies without gradients, thanks to a blame-aware mutation and diversity-aware selection process that pinpoints and fixes errors in individual modules.
LLM-based agents depend on effective tool-use policies to solve complex tasks, yet optimizing these policies remains challenging due to delayed supervision and the difficulty of credit assignment in long-horizon trajectories. Existing optimization approaches tend to be either monolithic, which are prone to entangling behaviors, or single-aspect, which ignore cross-module error propagation. To address these limitations, we propose EvoTool, a self-evolving framework that optimizes a modular tool-use policy via a gradient-free evolutionary paradigm. EvoTool decomposes agent's tool-use policy into four modules, including Planner, Selector, Caller, and Synthesizer, and iteratively improves them in a self-improving loop through three novel mechanisms. Trajectory-Grounded Blame Attribution uses diagnostic traces to localize failures to a specific module. Feedback-Guided Targeted Mutation then edits only that module via natural-language critique. Diversity-Aware Population Selection preserves complementary candidates to ensure solution diversity. Across four benchmarks, EvoTool outperforms strong baselines by over 5 points on both GPT-4.1 and Qwen3-8B, while achieving superior efficiency and transferability. The code will be released once paper is accepted.
