Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Generative Trajectory Planning (GTP), a model-based framework that resolves the inference efficiency vs. long-horizon reasoning trade-off in online decision-making by learning a generative model as a proposal distribution over action sequences. GTP samples candidate trajectories from a diffusion prior and refines them using learned dynamics, reward, and value models, enabling efficient trajectory-level reasoning. Empirical results demonstrate that GTP matches or surpasses state-of-the-art baselines on continuous control and long-horizon manipulation tasks, exhibiting superior stability in challenging regimes.
Generative models, when framed as proposal distributions for planning, unlock efficient long-horizon reasoning in model-based RL, outperforming diffusion policies and model-free methods.
Online decision-making faces a tension between efficient inference and long-horizon reasoning. Value-based methods rely on short-horizon bootstrapping that limits the propagation of long-term information, while trajectory optimization methods plan explicitly but must solve a high-dimensional optimization problem at every decision step. We propose Generative Trajectory Planning (GTP), a model-based framework that addresses this tension by learning a generative model as a proposal distribution over action sequences. Instead of optimizing sequences from scratch, GTP samples candidate sequences from a diffusion prior and refines them using learned dynamics, reward, and value models, enabling efficient trajectory-level reasoning. Across continuous control and long-horizon manipulation tasks, GTP matches or exceeds state-of-the-art model-free, diffusion-policy, and model-based baselines, and remains stable in regimes where strong baselines degrade. Our results suggest that generative models are best understood not as policies, but as structured proposal distributions for planning, offering a new perspective on how to integrate generative modeling with model-based decision-making.