Search papers, labs, and topics across Lattice.
This paper introduces MobileWan, a 5B-parameter video diffusion transformer that efficiently operates on mobile hardware, overcoming the limitations of smaller models. By employing a recurrence distillation framework and causal linear attention, the model achieves high-quality video generation while maintaining temporal coherence and low memory usage. The result is a state-of-the-art mobile video generation system capable of producing 5-second videos at 16 FPS with a VBench score of 83.79, setting a new benchmark in the field.
High-quality mobile video generation is now possible with a 5B-parameter model, challenging the notion that smaller models are necessary for mobile applications.
Recent advances in video diffusion have been driven by scaling transformer-based architectures to billions of parameters, substantially improving visual fidelity and motion coherence. In contrast, existing mobile video diffusion models remain limited to relatively small parameter budgets, typically 0.4-1.8B, restricting generation quality. In this work, we show that high-quality mobile video generation does not require small models. Instead, we demonstrate that a server-scale 5B-parameter video diffusion transformer can be deployed efficiently on memory-constrained mobile hardware through recurrent reformulation and structured compression. Starting from Wan2.2-5B, we rely on a recurrence distillation framework that converts video generation into a chunk-wise autoregressive process with constant-memory attention computation. Combined with causal linear attention, the model operates as an RNN at inference time while preserving temporal coherence across chunks. We further propose a learnable attention head pruning method based on binary per-head gates optimized end-to-end using a noise-biased sparsity objective and distillation-based finetuning. Together with sampling-step distillation and memory-optimized VAE decoding, MobileWan becomes the first 5B-scale video diffusion model deployable on a commercial mobile device. Our system generates 5-second 480x832 videos at 16 FPS in 20 seconds end-to-end latency, achieving a VBench score of 83.79 and establishing a new state of the art in mobile video generation. Project page: https://qualcomm-ai-research.github.io/mobilewan
