Search papers, labs, and topics across Lattice.
To resolve the tension between RL adaptability and classical control resilience in complex transport systems, the authors develop MPC-STMAPPO, a hierarchical controller coordinating lane-level variable speed limits and ramp metering across successive weaving segments. The architecture bridges long-horizon macroscopic flow optimization via an augmented L-METANET model with real-time residual adjustments from a multi-agent PPO agent enhanced by Mamba state-space blocks and graph attention, guided by XGBoost-SHAP-derived collision risk metrics. Tested on an 18-km expressway corridor, the hybrid policy significantly accelerates training convergence, achieves over 0.80 AUC in risk mitigation, and maintains robust generalization under high demand volatility where standalone MARL degrades.
Pairing multi-agent RL as a residual layer over physics-based model predictive control eliminates the out-of-distribution brittleness that typically prevents purely data-driven policies from operating in safety-critical physical systems.
Successive weaving segments (SWSs) on urban expressways are bottlenecks prone to recurrent congestion and collisions, requiring fine-grained active traffic management (ATM). Existing approaches struggle to balance the adaptive performance of data-driven optimization with the resilience and transferability of model-based control. We propose a hybrid framework to coordinate lane-level variable speed limits (VSLs) and ramp metering across SWSs. First, we reconstruct L-METANET, a lane-level macroscopic traffic flow model that captures free and forced lane changes. Second, we combine XGBoost-SHAP with a random-parameters binary logit (RPBL) model to derive analytical equations for merging and diverging collision risks and formulate system cost and reward functions. Third, we develop MPC-STMAPPO, a hierarchical controller integrating model predictive control (MPC) and multi-agent reinforcement learning (MARL). Its upper MPC layer uses L-METANET for long-horizon rolling optimization and generates baseline commands; its lower spatiotemporal MAPPO (ST-MAPPO) layer, enhanced with Mamba cells and graph attention, produces residual actions for short-horizon adjustment. Real-world experiments on the 18-km Eastern Expressway in Changchun, China, show that L-METANET accurately reproduces lane-changing-induced flow redistribution and capacity drops, with state evolution aligned with ground truth. XGBoost-SHAP-RPBL achieves AUCs above 0.80 in most tasks, outperforming conventional logit models. MPC-STMAPPO converges faster and performs better across multiple metrics than MPC- and MARL-based baselines. Under randomly fluctuating demand, it also significantly outperforms pure MARL in generalization, demonstrating strong potential for industrial deployment.