Search papers, labs, and topics across Lattice.
The paper introduces EchoStyle, a novel framework for high-fidelity video stylization that addresses significant challenges such as content leakage and style drift in existing methods. By leveraging a video-to-video architecture and an innovative reverse-synthesis pipeline to create the V-Style20k dataset, the authors enable effective stylization of videos of arbitrary lengths. Extensive experiments show that EchoStyle achieves performance on par with leading closed-source solutions, marking a significant advancement in intelligent content creation for video.
EchoStyle achieves high-quality video stylization without the content leakage and style drift that plague existing methods, even outperforming many proprietary systems.
While image stylization has been studied extensively, video stylization remains a critical and largely unsolved challenge in the field of intelligent content creation. Existing methods, usually utilizing a reference image as the style prior, suffer from content leakage, data scarcity and limited adaptability to long videos, leading to suboptimal results with severe style drift and motion distortion. For these issues, we present EchoStyle, a scalable text-driven framework to achieve high-quality stylization of videos with arbitrary lengths. To start with, we construct a video-to-video architecture to appropriately re-fuse the video content and the text style. To address data scarcity, we pioneer an automatic reverse-synthesis pipeline to establish V-Style20k, a large-scale stylization dataset of 20k high-quality video pairs. To facilitate long video stylization, we devise an init-follow-mode mechanism along with a sliding-window inference strategy. Extensive experiments demonstrate EchoStyle's excellent performance across a wide range of artistic styles, even comparable to leading closed-source solutions.
DAMO