Search papers, labs, and topics across Lattice.
This paper introduces Residual Refined Experts with Instance-level Gating (R2E-IG), a novel DRL-based approach for Vehicle Routing Problems (VRPs) designed to improve cross-distribution generalization. R2E-IG enhances expert expressiveness through residual refinement and uses an instance-level gating mechanism to route inputs to appropriate modules based on learned distribution-aware instance representations. A mixed-distribution training mechanism with Dynamic Weight Adaption (DWA) further improves generalization by dynamically reweighting training data from different distributions.
DRL agents can now solve vehicle routing problems across diverse real-world distributions thanks to a new architecture that adaptively recombines specialized policy modules.
In recent years, Deep Reinforcement Learning (DRL) has achieved substantial progress on Vehicle Routing Problems (VRPs). However, existing DRL-based methods are typically trained on instances generated from a uniform distribution, which limits their performance under real-world distribution shifts. In this paper, we aim to develop a generalization-oriented model that partitions the policy network into multiple modules and adaptively recombines modules to form specific policies during inference. Specifically, we propose Residual Refined Experts with Instance-level Gating (R2E-IG) to improve cross-distribution generalization. Our contributions are threefold: (1) We introduce a Residual Refined Expert (R2E) architecture that enhance expert expressiveness via residual refinement; (2) We design an instance-level gating mechanism that learns distribution-aware instance representations and routes inputs to suitable modules; (3) We propose a mixed-distribution training mechanism equipped with Dynamic Weight Adaption (DWA), which dynamically reweights training data from different distributions to emphasize more informative ones. Extensive experiments show that R2E-IG achieves competitive performance against state-of-the-art baselines on both in-distribution and out-of-distribution instances across synthetic and benchmark datasets. Moreover, R2E-IG is generic and can be easily integrated into existing DRL-based methods to further improve performance.
