Search papers, labs, and topics across Lattice.
This paper introduces Self-supervised Action Gating with Energies (SAGE), a method to improve diffusion planners in offline reinforcement learning by re-ranking sampled trajectories based on dynamic consistency. SAGE uses a Joint-Embedding Predictive Architecture (JEPA) to learn a latent consistency signal from offline state sequences and penalizes dynamically inconsistent plans during inference. Experiments across locomotion, navigation, and manipulation tasks demonstrate that SAGE enhances the performance and robustness of diffusion planners without requiring environment rollouts or policy re-training.
Diffusion planners get a boost in robustness and performance thanks to SAGE, a self-supervised method that weeds out dynamically inconsistent plans using a learned latent consistency signal.
Diffusion planners are a strong approach for offline reinforcement learning, but they can fail when value-guided selection favours trajectories that score well yet are locally inconsistent with the environment dynamics, resulting in brittle execution. We propose Self-supervised Action Gating with Energies (SAGE), an inference-time re-ranking method that penalises dynamically inconsistent plans using a latent consistency signal. SAGE trains a Joint-Embedding Predictive Architecture (JEPA) encoder on offline state sequences and an action-conditioned latent predictor for short horizon transitions. At test time, SAGE assigns each sampled candidate an energy given by its latent prediction error and combines this feasibility score with value estimates to select actions. SAGE can integrate into existing diffusion planning pipelines that can sample trajectories and select actions via value scoring; it requires no environment rollouts and no policy re-training. Across locomotion, navigation, and manipulation benchmarks, SAGE improves the performance and robustness of diffusion planners.
CMU ML
Microsoft Research
Tsinghua AI