Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a reparameterized curriculum generation framework that utilizes unidirectional gradient-based optimization to enhance the robustness of navigation policies in autonomous agents across varying environmental conditions. By incorporating a distribution-shift regularization objective, the framework encourages the development of finer-grained latent representations in multimodal observation spaces. Evaluations in two continuous-control environments show that this method consistently outperforms traditional training approaches and various baseline methods, highlighting its effectiveness in improving policy performance under structured parametric conditions.
Curriculum generation can significantly enhance the robustness of navigation policies, outperforming established training methods across diverse environments.
Robust navigation policies for autonomous agents must generalize across continuously varying environmental conditions such as turn rates, obstacles, friction, pits, and slopes. Curriculum generation provides a principled mechanism for improving generalization by progressively adapting training environments, but designing such curricula in a sample-efficient and automated manner remains challenging. This paper proposes a reparameterized curriculum generation framework for structured continuous environment parameters using unidirectional gradient-based optimization. To improve robustness in multimodal observation spaces consisting of image-based and scalar inputs, a distribution-shift regularization objective is incorporated to encourage the learning of finer-grained latent representations. The proposed method is evaluated across two continuous-control OpenAI Gym environments: a 2D obstacle-based Car Racing variant and Bipedal Walker variant, where coupled environment parameters jointly influence policy performance. Across five random seeds, our method consistently outperforms vanilla policy training, random parameter sampling, manual curricula, frontier-based methods, Self-Paced Reinforcement Learning (SPRL), Absolute Learning Progress with Gaussian Mixture Models (ALP-GMM), and reverse curriculum learning baselines. Ablation studies further demonstrate the effectiveness of the reparameterized curriculum mechanism across both environments, while highlighting environment-dependent benefits of the auxiliary regularization objective.