Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
FlowVVTON introduces a novel mask-free framework for video virtual try-on that leverages optical flow as a training-time supervision signal to enhance temporal consistency without relying on human parsing masks or pose keypoints. By employing a two-stage training strategy, the model first establishes spatial alignment and then incorporates flow-guided temporal supervision, effectively addressing the limitations of existing methods that struggle with large motions and occlusions. Experimental results on TikTokDress demonstrate a significant improvement in temporal consistency, achieving a 5.7× VFID-R enhancement over the previous state-of-the-art, SwiftTry, while eliminating the need for segmentation masks or annotations.
FlowVVTON achieves a groundbreaking 5.7× improvement in temporal consistency for video virtual try-on without relying on any segmentation masks or pose keypoints.
Video virtual try-on aims to transfer a target garment onto a moving person across video frames. Current methods rely on human parsing masks or pose keypoints that frequently fail under large motions and occlusions, causing boundary artifacts and temporal inconsistency. A further limitation is that most approaches rely solely on attention mechanisms for temporal modeling, providing no explicit motion supervision. We propose FlowVVTON, a mask-free framework that eliminates parsing mask dependency entirely. Optical flow is used solely as a training-time supervision signal: a flow-warped latent loss, applied across all layers of the generation model, enforces multi-scale temporal consistency by aligning adjacent-frame features under explicit physical motion constraints. A two-stage training strategy establishes mask-free spatial alignment before introducing flow-guided temporal supervision. Experiments on TikTokDress show that FlowVVTON outperforms baselines by substantial margins, particularly in temporal consistency (5.7$\times$ VFID-R improvement over SwiftTry), while requiring no segmentation masks, pose keypoints, or region annotations at any stage.