Search papers, labs, and topics across Lattice.
This paper tackles city-scale EV ride-hailing fleet management by formulating it as a hex-grid semi-MDP with hybrid actions (discrete dispatch/repositioning/charging and continuous charging power). To ensure feasibility, they introduce a masked, temperature-annealed actor that generates high-level intentions, projected via a rolling MILP enforcing physical constraints at each step. They then optimize a Soft Actor-Critic (SAC) agent against a Wasserstein-1 ambiguity set, using a graph-aligned Mahalanobis metric to capture spatial correlations, achieving a net profit of $1.22M in NYC taxi data simulations, significantly outperforming heuristic and RL baselines while maintaining zero feeder-limit violations.
Achieve a \$1.22M profit in city-scale EV ride-hailing by combining semi-Markov RL with a feasibility-guaranteed MILP projection, outperforming strong baselines and eliminating feeder-limit violations.
We study city-scale control of electric-vehicle (EV) ride-hailing fleets where dispatch, repositioning, and charging decisions must respect charger and feeder limits under uncertain, spatially correlated demand and travel times. We formulate the problem as a hex-grid semi-Markov decision process (semi-MDP) with mixed actions -- discrete actions for serving, repositioning, and charging, together with continuous charging power -- and variable action durations. To guarantee physical feasibility during both training and deployment, the policy learns over high-level intentions produced by a masked, temperature-annealed actor. These intentions are projected at every decision step through a time-limited rolling mixed-integer linear program (MILP) that strictly enforces state-of-charge, port, and feeder constraints. To mitigate distributional shifts, we optimize a Soft Actor--Critic (SAC) agent against a Wasserstein-1 ambiguity set with a graph-aligned Mahalanobis ground metric that captures spatial correlations. The robust backup uses the Kantorovich--Rubinstein dual, a projected subgradient inner loop, and a primal--dual risk-budget update. Our architecture combines a two-layer Graph Convolutional Network (GCN) encoder, twin critics, and a value network that drives the adversary. Experiments on a large-scale EV fleet simulator built from NYC taxi data show that PD--RSAC achieves the highest net profit, reaching \$1.22M, compared with \$0.58M--\$0.70M for strong heuristic, single-agent RL, and multi-agent RL baselines, including Greedy, SAC, MAPPO, and MADDPG, while maintaining zero feeder-limit violations.
