Search papers, labs, and topics across Lattice.
This paper addresses the challenges of Lifelong Multi-Agent Path Finding (LMAPF) by introducing a more realistic model, LMAPF-R2, which incorporates robust safety and rotation constraints critical for real-world applications. The authors propose Search-Aided Joint Reinforcement Learning (SJRL), which enhances neural policies with a search-based planner to resolve collisions and optimize agent coordination. Experimental results show that SJRL significantly outperforms traditional search-based planners in both simulated and mixed-reality environments, demonstrating its effectiveness in complex scenarios with high-density agent interactions.
SJRL not only overcomes collision challenges in multi-agent navigation but also adapts dynamically to real-world constraints, outperforming traditional methods in complex environments.
Lifelong Multi-Agent Path Finding (LMAPF) requires repeatedly planning collision-free paths for agents that continuously receive new goals upon reaching their current ones. While many learning-based planners have been proposed for LMAPF, most rely on oversimplified kinematic assumptions that may overlook motion constraints critical to real-world performance. In this work, we study a more realistic LMAPF model derived from many real-world automated warehouse systems, termed LMAPF-R2, which incorporates robust safety constraints and in-place rotation constraints. These constraints substantially increase coordination difficulty, particularly in highly constrained spaces. To address these challenges, we propose Search-Aided Joint Reinforcement Learning (SJRL). We first augment neural policies with Causal PIBT, a single-step search-based planner that resolves agents'collisions and propagates their intentions. We then introduce a unified RL formulation that jointly optimizes agent and environment policies, where the environment policy learns graph edge costs to provide global movement guidance via backward Dijkstra search. Experiments demonstrate that SJRL achieves significant improvements over the strong search-based planner, Causal-PIBT, across multiple high-density maps. We further validate SJRL in a challenging mixed-reality warehouse environment with 8 physical robots and 248 virtual robots.
CMU ML