Search papers, labs, and topics across Lattice.
This paper introduces Diffusion ReRoll, a novel diffusion-based framework that enhances robotic sequential prediction by allowing for revisable denoising across prediction horizons. Unlike traditional methods that apply a single, monotonic denoising process, Diffusion ReRoll selectively re-noises stable regions while continuing to denoise others, enabling iterative refinement and cross-horizon revisions. The framework demonstrates significant performance improvements, achieving a 21% increase in success rate on planning tasks and a 56.5% boost in action prediction accuracy across various benchmarks.
Selective re-noising in Diffusion ReRoll enables robots to iteratively refine predictions, leading to unprecedented improvements in long-horizon planning and action prediction.
We propose Diffusion ReRoll, a diffusion-based framework for robotic sequential prediction that enables revisable denoising over horizons. Existing diffusion-based sequence predictors typically perform a single monotonic denoising process. In contrast, Diffusion ReRoll selectively re-noises regions that have become locally stable while the remaining regions continue denoising, so the re-noised regions can be refined again using context from the rest of the horizon. This structured re-noising enables iterative cross-horizon revision, allowing earlier and later segments to revise one another, while maintaining local consistency. We evaluate Diffusion ReRoll against full-sequence diffusion and causal denoising based on Diffusion Forcing across long-horizon planning, policy learning, and unified video-action modeling. On OGBench PointMaze and AntMaze, Diffusion ReRoll achieves relative gains in average success rate of 21% over Diffusion Forcing in matched guidance-based planning and 23% over Diffuser in matched goal-inpainting. In diffusion-policy-style action prediction, Diffusion ReRoll improves average success by 56.5% relative to Diffusion Policy across different prediction horizons and history lengths on the LIBERO-10 multi-task benchmark. In unified video-action prediction, Diffusion ReRoll improves policy and inverse dynamics performance, especially under out-of-distribution evaluation, and achieves the best action-video consistency. These results support structured re-noising as an effective mechanism for revisable robotic sequence generation.