Search papers, labs, and topics across Lattice.
The paper introduces HiAR, a hierarchical denoising framework for autoregressive video generation that addresses error accumulation and temporal discontinuity. HiAR reverses the conventional generation order by performing causal generation across all blocks at each denoising step, conditioning on context at the same noise level to mitigate error propagation. They further introduce a forward-KL regularizer to counteract low-motion shortcuts amplified by self-rollout distillation. HiAR achieves state-of-the-art performance on VBench, demonstrating improved temporal consistency and overall quality with a 1.8x speedup through pipelined parallel inference.
Autoregressive video generation gets a 1.8x speed boost and avoids temporal drift by denoising all blocks hierarchically at the same noise level.
Autoregressive (AR) diffusion offers a promising framework for generating videos of theoretically infinite length. However, a major challenge is maintaining temporal continuity while preventing the progressive quality degradation caused by error accumulation. To ensure continuity, existing methods typically condition on highly denoised contexts; yet, this practice propagates prediction errors with high certainty, thereby exacerbating degradation. In this paper, we argue that a highly clean context is unnecessary. Drawing inspiration from bidirectional diffusion models, which denoise frames at a shared noise level while maintaining coherence, we propose that conditioning on context at the same noise level as the current block provides sufficient signal for temporal consistency while effectively mitigating error propagation. Building on this insight, we propose HiAR, a hierarchical denoising framework that reverses the conventional generation order: instead of completing each block sequentially, it performs causal generation across all blocks at every denoising step, so that each block is always conditioned on context at the same noise level. This hierarchy naturally admits pipelined parallel inference, yielding a 1.8 wall-clock speedup in our 4-step setting. We further observe that self-rollout distillation under this paradigm amplifies a low-motion shortcut inherent to the mode-seeking reverse-KL objective. To counteract this, we introduce a forward-KL regulariser in bidirectional-attention mode, which preserves motion diversity for causal inference without interfering with the distillation loss. On VBench (20s generation), HiAR achieves the best overall score and the lowest temporal drift among all compared methods.
