Search papers, labs, and topics across Lattice.
PRIMAL3 is a novel multi-agent pathfinding framework that leverages reinforcement learning and LaCAM3-guided training to enhance coordination among agents in complex environments. By focusing on topologically critical states and employing a dual-graph structure to manage agent interactions, the framework effectively addresses bottlenecks and conflicts during navigation. Experimental results show that PRIMAL3 significantly outperforms existing learning-based methods and is capable of scaling to scenarios with up to 100,000 agents, demonstrating its practical applicability in real-world robotic systems.
PRIMAL3 achieves unprecedented scalability in multi-agent pathfinding, successfully coordinating 100,000 agents while navigating complex environments.
We present PRIMAL3, an ultra-large-scale learning-based framework for multi-agent pathfinding (MAPF) that integrates reinforcement learning, topology-aware communication, LaCAM3-guided training, and PIBT-based action refinement. PRIMAL3 targets failures at topologically critical states, where agents must coordinate decisively around bottlenecks, dead ends, and persistent conflicts. Each agent is represented using features derived from cut vertices, dead-end regions, shortest-path distances, and blocking estimates. Two complementary graphs capture agent interactions: a same-direction following graph propagates multihop context along compatible paths, while a different-direction conflict graph differentiates agents competing for shared space through masked attention and relative features. During training, we propose to let policy entropy identify uncertain agents, for which LaCAM3 provides confidence-triggered action interventions and label-smoothed imitation targets. During execution, a priority-aware PIBT module refines the proposed joint actions using persistent, learned, and distance-aware priorities together with policy-aware fallback preferences while maintaining collision-free execution. The resulting framework combines learned exploration with structured expert guidance without requiring LaCAM3 at inference. Experiments demonstrate that PRIMAL3 substantially outperforms state-of-the-art learning-based baselines and scales to ultra-large instances with up to city-level 100,000 agents. Real-world experiments further demonstrate the feasibility of deploying PRIMAL3 on physical robotic systems and ablation studies validate the individual contributions the components we proposed. Project page: https://marmotlab.github.io/PRIMAL3/
