Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Master-Agent Proto-plan System (MAPS), a hierarchical deep reinforcement learning architecture designed to improve coordination among autonomous vehicles at unsignalized intersections. By generating a compact embedding called a proto-plan, the centralized Master agent provides a global coordination strategy that Worker agents use to execute vehicle-specific controls, allowing for independent optimization of strategic and tactical components. The evaluation shows that MAPS not only achieves collision-free navigation across diverse intersection configurations but also significantly reduces average travel time, with impressive generalization capabilities demonstrated in zero-shot scenarios.
Collision-free navigation at unsignalized intersections is possible with a hierarchical approach that decouples strategic intent from tactical execution, achieving a 94% success rate in zero-shot scenarios.
Coordinating autonomous vehicles at unsignalized intersections remains a critical challenge for multi-agent reinforcement learning (MARL) systems, which typically struggle with combinatorial action spaces, reliance on privileged information, or rigid agent designs. We propose Master-Agent Proto-plan System (MAPS), a hierarchical deep reinforcement learning (DRL) architecture in which a centralized Master agent generates a compact, continuous embedding, denoted as proto-plan, that encodes a global coordination strategy. Decentralized Worker agents integrate this embedding with local observations to execute vehicle-specific control, decoupling strategic intent from tactical execution and enabling independent optimization of each module. As a proof-of-concept evaluation of this coordination mechanism, we test MAPS across 72 intersection configurations in HighwayEnv. MAPS achieves collision-free navigation while significantly reducing average travel time, outperforming state-of-the-art baselines. The learned proto-plans further exhibit robust generalization: a system trained with three agents achieves a 94% success rate when deployed zero-shot to five-agent scenarios, confirming that proto-plan-based hierarchical learning provides a promising framework for multi-vehicle coordination.