Search papers, labs, and topics across Lattice.
This paper introduces an integrated Model Predictive Control (MPC) and Deep Reinforcement Learning (RL) framework (MPC-RL) for autonomous driving at unsignalized intersections. MPC provides structured constraint handling, while RL learns adaptive behaviors, aiming to overcome the limitations of each method when used alone. Experiments demonstrate that MPC-RL reduces collision rates by 21% and improves success rates by 6.5% compared to pure MPC, while also exhibiting better zero-shot transfer to highway merging scenarios than end-to-end RL.
Fusing MPC with RL yields safer and more efficient autonomous driving at intersections, outperforming both standalone MPC and end-to-end RL, and surprisingly generalizing better to new scenarios.
Automated driving at unsignalized intersections is challenging due to complex multi-vehicle interactions and the need to balance safety and efficiency. Model Predictive Control (MPC) offers structured constraint handling through optimization but relies on hand-crafted rules that often produce overly conservative behavior. Deep Reinforcement Learning (RL) learns adaptive behaviors from experience but often struggles with safety assurance and generalization to unseen environments. In this study, we present an integrated MPC-RL framework to improve navigation performance in multi-agent scenarios. Experiments show that MPC-RL outperforms standalone MPC and end-to-end RL across three traffic-density levels. Collectively, MPC-RL reduces the collision rate by 21% and improves the success rate by 6.5% compared to pure MPC. We further evaluate zero-shot transfer to a highway merging scenario without retraining. Both MPC-based methods transfer substantially better than end-to-end PPO, which highlights the role of the MPC backbone in cross-scenario robustness. The framework also shows faster loss stabilization than end-to-end RL during training, which indicates a reduced learning burden. These results suggest that the integrated approach can improve the balance between safety performance and efficiency in multi-agent intersection scenarios, while the MPC component provides a strong foundation for generalization across driving environments. The implementation code is available open-source.
NVIDIA