Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
To overcome the rigidity of fixed system prompts in multi-agent LLM ensembles, this work develops SAGE (Self-Adapting Group of Experts), a training-free framework that dynamically adapts agents' reasoning strategies at test time. The system identifies a high-performing "strategy donor" through answer agreement, prefix consistency, and reciprocal peer review, transplanting its reasoning approach into peer system prompts while preserving their assigned roles. Evaluated across diverse reasoning benchmarks and backbones, SAGE consistently outperforms conventional static-prompt multi-agent architectures by routing refined interactions through a dynamic, confidence-ordered directed acyclic graph.
Multi-agent collaboration bottlenecks when agent personas stay rigid, but dynamic, test-time strategy transplantation across system prompts enables heterogeneous LLMs to collectively align on the most effective reasoning path.
Multi-agent systems bring together language model agents with different roles to propose, review, and refine solutions. Each agent's response depends on its model's capabilities, the reasoning strategy defined by its system prompt, and the information in its input context. Existing frameworks often adapt communication by changing this context while leaving individual prompts fixed, even when a problem calls for different skills. We study whether agents' initial responses can identify a strategy better suited to the current problem and guide its transfer to other agents. To address this, we introduce SAGE (Self-Adapting Group of Experts), a training-free framework that uses answer agreement, prefix consistency, and reciprocal peer review to select a strategy donor. SAGE transfers the selected donor's reasoning strategy to the other agents while preserving their original roles. This transfer uses only the agents' original system prompts, without access to the problem or generated solutions. After strategy adaptation, agents exchange responses through a dynamic, sparse directed acyclic graph that routes information from higher-scoring agents to lower-scoring agents. Experiments across multiple agent backbones and reasoning benchmarks show that SAGE achieves higher average accuracy than the evaluated baselines. Our code is available at https://github.com/atifquamar07/sage.
RIKEN