Search papers, labs, and topics across Lattice.
This paper introduces Reward-Guided Autoregressive Graph Generation (RGA-Designer), which enhances the efficiency of Multi-Agent Systems (MAS) by optimizing the communication topology through a novel reward model. By incorporating a reward mechanism that balances task correctness and structural compactness, RGA-Designer fine-tunes the graph generator to produce sparser topologies. The key finding is that RGA-Designer maintains the performance level of its predecessor, ARG-Designer, while achieving an average reduction of 20.5% in token consumption.
RGA-Designer cuts token consumption by over 20% without sacrificing task accuracy, revolutionizing how we design communication topologies in multi-agent systems.
LLM-based Multi-Agent Systems (MAS) achieve strong performance on complex reasoning tasks by coordinating multiple agents, but at the cost of substantial token consumption. Recent work on automatic topology design, ARG-Designer, has reframed this problem as autoregressive graph generation. However, its training objective provides no explicit incentive for the model to generate sparse and efficient topologies. We address this limitation by introducing a Reward-Guided Autoregressive Graph Generation (RGA-Designer) inspired by Reinforcement Learning from Human Feedback (RLHF). We train a reward model that jointly captures task correctness and structural compactness, and then fine-tune the pretrained graph generator using the reward model as feedback. Our method preserves task accuracy at the level of ARG-Designer while reducing token consumption by an average of 20.5%.
