Search papers, labs, and topics across Lattice.
This paper introduces a two-stage reward curriculum for robotic reinforcement learning that decouples task-specific objectives from behavioral terms like energy efficiency. The agent is first trained on a simplified task-only reward to encourage exploration, then the full reward including behavioral terms is introduced. Experiments across DeepMind Control Suite, ManiSkill3, and a mobile robot environment demonstrate that this approach outperforms baselines trained directly on the full reward and exhibits higher robustness to reward weightings.
Forget painstakingly tuning reward weights: this two-stage curriculum trains robots more effectively by first focusing on task completion, then layering in desired behaviors.
Deep Reinforcement Learning is a promising tool for robotic control, yet practical application is often hindered by the difficulty of designing effective reward functions. Real-world tasks typically require optimizing multiple objectives simultaneously, necessitating precise tuning of their weights to learn a policy with the desired characteristics. To address this, we propose a two-stage reward curriculum where we decouple task-specific objectives from behavioral terms. In our method, we first train the agent on a simplified task-only reward function to ensure effective exploration before introducing the full reward that includes auxiliary behavior-related terms such as energy efficiency. Further, we analyze various transition strategies and demonstrate that reusing samples between phases is critical for training stability. We validate our approach on the DeepMind Control Suite, ManiSkill3, and a mobile robot environment, modified to include auxiliary behavioral objectives. Our method proves to be simple yet effective, substantially outperforming baselines trained directly on the full reward while exhibiting higher robustness to specific reward weightings.
