Search papers, labs, and topics across Lattice.
This paper introduces Stochastic Decoupled Policy Gradient (SDPG), a visual RL method that estimates policy gradients through random trajectory perturbations, significantly reducing the number of required batch-rendered environments. SDPG achieves superior performance compared to existing methods in terms of training time, memory usage, and rewards on visual MuJoCo benchmarks. The authors also provide a new suite of realistic visual robotics benchmarks and demonstrate successful sim-to-real transfer.
Visual RL training can be sped up by orders of magnitude using trajectory perturbations, achieving state-of-the-art results on MuJoCo with just a single RTX 4080.
We present the stochastic decoupled policy gradient (SDPG), a lightweight visual reinforcement learning (RL) method that trains diverse visuomotor control policies end-to-end within a few hours on a single NVIDIA RTX 4080 GPU. SDPG estimates policy gradients via random perturbations of trajectory rollouts, requiring orders of magnitude fewer batch-rendered environments and substantially reducing compute and memory overhead. On visual MuJoCo benchmarks, SDPG consistently outperforms baseline methods in training time, memory usage, and rewards. Finally, to support future research, we introduce a suite of realistic visual robotics benchmarks spanning dexterous manipulation, challenging locomotion, and demonstrate effective sim-to-real transfer on physical hardware.
