Search papers, labs, and topics across Lattice.
This paper introduces ReM-MoA, a memory-augmented Mixture-of-Agents framework designed to enhance the scalability of reasoning in layered architectures. By implementing a Ranked Reasoning Memory and a Curated Diversified Memory Routing scheme, ReM-MoA effectively maintains performance gains across increased depth and width in reasoning tasks. The results demonstrate significant improvements over existing MoA variants on five diverse reasoning benchmarks, highlighting the importance of structured cross-layer reasoning memory for scalable multi-agent inference.
ReM-MoA reveals that structured cross-layer reasoning memory can dramatically enhance the scalability of multi-agent systems, outperforming traditional methods as complexity increases.
Mixture-of-Agents (MoA) architectures improve inference-time scaling by organizing multiple LLM agents into layered reasoning pipelines. However, existing MoA variants fail to sustain gains as depth increases, exhibiting degradation, early plateauing, or saturation. We propose ReM-MoA, a memory-augmented MoA framework that sustains scaling through two mechanisms: (1) a Ranked Reasoning Memory that persistently stores and ranks reasoning traces from all layers using a comparative Reviewer Agent, and (2) a Curated Diversified Memory Routing scheme that exposes different agents to distinct combinations of successful and failed traces, preserving exploration diversity while propagating high-quality reasoning. We further introduce an optional multi-domain Reviewer distillation pipeline that improves ranking quality through frontier-model supervision. Across five reasoning benchmarks spanning math, formal logic, code, knowledge, and commonsense, ReM-MoA consistently outperforms prior MoA variants across both depth and width scaling, and its advantage widens with depth, establishing structured cross-layer reasoning memory as a key missing mechanism for scalable multi-agent inference.
