Search papers, labs, and topics across Lattice.
This paper introduces JoyAI-Video-Edit, a 16B-parameter autoregressive diffusion model designed for real-time, open-ended video editing that operates without future frame access or fixed video duration. The framework employs innovative techniques such as chunk-wise autoregressive adaptation and Source-Anchored Distribution Matching Distillation to enhance fidelity and consistency during the editing process. Evaluations reveal that JoyAI-Video-Edit significantly surpasses existing streaming editors and competes effectively with offline systems, achieving 720p editing at approximately 30 FPS on a single Nvidia B200 GPU.
JoyAI-Video-Edit achieves real-time video editing at 30 FPS while maintaining high fidelity and temporal consistency, outperforming traditional streaming editors.
Real-time video editing requires low-latency causal generation with bounded computational resources while preserving source fidelity and long-term temporal consistency. We present JoyAI-Video-Edit, a 16B-parameter autoregressive diffusion framework for real-time, open-ended video editing without access to future frames or a predefined video duration. Our method combines chunk-wise autoregressive adaptation, Source-Anchored Distribution Matching Distillation (SA-DMD), and Long-Horizon Autoregressive Distillation to reduce train--inference mismatch, preserve source fidelity during two-step generation, and mitigate accumulated temporal drift. Extensive automatic and human evaluations show that JoyAI-Video-Edit substantially outperforms existing streaming editors and remains competitive with strong offline systems on both short and long videos. The complete system achieves end-to-end 720p video editing at approximately 30 FPS on a single Nvidia B200 GPU. Code is available at https://github.com/jd-opensource/JoyAI-Video-Edit.
