Search papers, labs, and topics across Lattice.
The paper introduces AgentDropoutV2, a test-time rectify-or-reject pruning framework for multi-agent systems that dynamically optimizes information flow by intercepting agent outputs and correcting errors using a retrieval-augmented rectifier. This rectifier leverages a failure-driven indicator pool to identify potential errors based on distilled failure patterns, pruning irreparable outputs to prevent error propagation. Empirical results on math benchmarks demonstrate that AgentDropoutV2 significantly improves task performance, achieving an average accuracy gain of 6.3 percentage points, while also exhibiting robust generalization and adaptivity.
Multi-agent systems get a 6.3% accuracy boost on math problems thanks to a new "rectify-or-reject" pruning method that dynamically filters out bad information at test time.
While Multi-Agent Systems (MAS) excel in complex reasoning, they suffer from the cascading impact of erroneous information generated by individual participants. Current solutions often resort to rigid structural engineering or expensive fine-tuning, limiting their deployability and adaptability. We propose AgentDropoutV2, a test-time rectify-or-reject pruning framework designed to dynamically optimize MAS information flow without retraining. Our approach acts as an active firewall, intercepting agent outputs and employing a retrieval-augmented rectifier to iteratively correct errors based on a failure-driven indicator pool. This mechanism allows for the precise identification of potential errors using distilled failure patterns as prior knowledge. Irreparable outputs are subsequently pruned to prevent error propagation, while a fallback strategy preserves system integrity. Empirical results on extensive math benchmarks show that AgentDropoutV2 significantly boosts the MAS's task performance, achieving an average accuracy gain of 6.3 percentage points on math benchmarks. Furthermore, the system exhibits robust generalization and adaptivity, dynamically modulating rectification efforts based on task difficulty while leveraging context-aware indicators to resolve a wide spectrum of error patterns. Our code and dataset are released at https://github.com/TonySY2/AgentDropoutV2.
Tsinghua AI