Search papers, labs, and topics across Lattice.
This paper introduces UniTeD, a Unified Temporal Diffusion framework that integrates perception and planning in autonomous driving by leveraging iterative denoising in a shared generative space. By enabling bidirectional information exchange and employing a Temporal Transition Module (TTM) to handle noise-level mismatches, the framework enhances robustness and optimization efficiency in multi-modal planning. UniTeD achieves state-of-the-art performance across various benchmarks, outperforming both recent discriminative methods and existing diffusion-based approaches in end-to-end driving tasks.
A unified approach to perception and planning in autonomous driving that significantly boosts robustness and performance by addressing noise-level mismatches.
Diffusion models have shown strong potential for multi-modal planning in end-to-end autonomous driving. However, most existing methods confine diffusion to the planning module, conditioning on fixed outputs from separate discriminative perception networks. This decoupled design propagates perception errors to the planner, increasing optimization difficulty and reducing robustness. To overcome these limitations, we propose UniTeD, a Unified Temporal Diffusion framework that jointly models perception and planning through iterative denoising in a shared generative space. By enabling bidirectional information exchange, the framework facilitates mutual refinement between tasks and improves robustness via noise-conditioned multi-task training. We further extend this unified diffusion paradigm to a streaming setting by incorporating temporal context. A Temporal Transition Module (TTM) is introduced to resolve the noise-level mismatch between historical and current frames. In addition, we propose an Anchor Refresh Strategy (ARS) to alleviate the training-inference distribution shift commonly observed in sparse diffusion-based end-to-end driving frameworks. Without bells and whistles, UniTeD achieves state-of-the-art performance across multiple benchmarks, surpassing both recent discriminative end-to-end methods and diffusion-based planning approaches.
