Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DiFA, a novel framework that redefines inference in diffusion models by treating data prediction refinement as a sequential state estimation problem rather than a numerical integration task. By leveraging a Kalman filtering-inspired approach, DiFA aggregates historical predictions to achieve a forward-aligned temporal consensus, addressing the limitations of traditional methods that overlook statistical uncertainty. The results show substantial improvements in generative fidelity on CIFAR-10 and ImageNet, indicating that aligning inference with the forward statistical structure enhances model performance across key metrics like FID and IS.
Aligning inference with the forward statistical structure of diffusion models can dramatically boost generative fidelity, as evidenced by significant performance gains on CIFAR-10 and ImageNet.
The prevailing inference framework for diffusion models formulates generation fundamentally as a problem of numerical integration. This perspective casts the model as an exact estimator, neglecting the inherent statistical uncertainty of the denoising process. In this work, we propose Forward-Process Aligned Diffusion prediction (DiFA), a training-free framework that reframes inference-time data prediction refinement as a sequential state estimation problem. Rather than reusing past outputs solely for numerical integration, DiFA treats iterative data predictions along the reverse trajectory as correlated observations to build a forward-aligned temporal consensus. Inspired by Kalman filtering, this consensus aggregates historical predictions according to structural consistency and noise-level compatibility. To counteract the over-smoothing tendency of temporal consensus, we introduce a deviation guidance mechanism to adaptively preserve residual details. Empirically, DiFA yields significant improvements on CIFAR-10 and ImageNet across the evaluated metrics, including FID, IS, and FD-DINOv2, demonstrating that aligning inference with the forward statistical structure substantially improves generative fidelity.