Search papers, labs, and topics across Lattice.
This paper introduces SteerGenPO, a novel latent-space reinforcement learning framework that enhances the stability of generative policies for robotic control by replacing stochastic latent sampling with a learned deterministic latent actor. The approach allows for rich exploration during training while ensuring precise and robust control during deployment, addressing the challenges posed by the stochastic nature of traditional diffusion policies in high-dimensional robotic systems. Evaluations on various benchmarks demonstrate that SteerGenPO outperforms classical and generative RL baselines, yielding more stable behaviors and reliable responses in real-time applications.
SteerGenPO achieves robust robotic control by transforming stochastic generative policies into stable deterministic actions, significantly enhancing performance in dynamic environments.
Diffusion and flow-based generative policies provide a powerful policy class for reinforcement learning by inducing rich stochastic exploration through iterative action generation. However, the stochasticity of diffusion policies is not suitable for stable and precise control in high-dimensional robotic systems, where small action variations can accumulate into inconsistent motion and reduced robustness. To address this issue, we propose SteerGenPO, a latent-space reinforcement learning framework that steers a trained generative policy into a robust deterministic robotic controller. The key idea is to replace stochastic latent sampling of the trained generative policy with a learned latent actor that predicts a state-dependent latent input for the generative policies. This separates exploration and control: stochastic generative sampling provides diverse action proposals during policy learning, while deterministic latent steering provides stable and adaptive control at deployment. We evaluate SteerGenPO on six Isaac Lab benchmarks and a Unitree G1 locomotion task. The results show SteerGenPO improves over both classical RL and generative RL baselines, while its deterministic latent steering produces more stable inference-time behaviors and more reliable command responses.
