Search papers, labs, and topics across Lattice.
This paper introduces Textual Parameter Graph Optimization (TPGO), a novel framework that enables multi-agent systems (MAS) to autonomously evolve by learning from their optimization experiences. By modeling MAS as a Textual Parameter Graph and utilizing "textual gradients" for structured feedback, TPGO enhances the optimization process through a meta-learning strategy called Group Relative Agent Optimization (GRAO). Experimental results on complex benchmarks demonstrate that TPGO significantly improves the performance of existing agent frameworks, achieving higher success rates through self-improvement mechanisms.
TPGO allows multi-agent systems to learn from their own optimization history, leading to unprecedented self-improvement in performance.
Designing and optimizing multi-agent systems (MAS) is a complex, labor-intensive process of "Agent Engineering." Existing automatic optimization methods, primarily focused on flat prompt tuning, lack the structural awareness to debug the intricate web of interactions in MAS. More critically, these optimizers are static; they do not learn from experience to improve their own optimization strategies. To address these gaps, we introduce Textual Parameter Graph Optimization (TPGO), a framework that enables a multi-agent system to learn to evolve. TPGO first models the MAS as a Textual Parameter Graph (TPG), where agents, tools, and workflows are modular, optimizable nodes. To guide evolution, we derive "textual gradients," structured natural language feedback from execution traces, to pinpoint failures and suggest granular modifications. The core of our framework is Group Relative Agent Optimization (GRAO), a novel meta-learning strategy that learns from historical optimization experiences. By analyzing past successes and failures, GRAO becomes progressively better at proposing effective updates, allowing the system to learn how to optimize itself. Extensive experiments on complex benchmarks like GAIA and MCP-Universe show that TPGO significantly enhances the performance of state-of-the-art agent frameworks, achieving higher success rates through automated, self-improving optimization.
DAMO