Search papers, labs, and topics across Lattice.
This paper introduces BooM-VVT, a mask-free video virtual try-on framework that enhances garment realism in generated videos by leveraging image-level pseudo data instead of relying on expensive video-level data. The authors implement a multi-stage training strategy and Garment-Sensitive Keyframe Sampling to improve garment consistency and detail transfer across keyframes. Extensive experiments show that BooM-VVT outperforms existing methods in terms of temporal consistency and garment fidelity, making it a significant advancement in the field of video virtual try-on.
Achieving mask-free video virtual try-on is now possible with BooM-VVT, which significantly reduces reliance on costly video-level data while enhancing garment realism.
Video virtual try-on (VVT) aims to generate realistic videos of a person wearing a target garment. Recent methods leverage a keyframe-driven video generation paradigm to improve in-the-wild performance, yet they still rely on masks to localize try-on regions, making them vulnerable to large motions and severe occlusions. Although mask-free image-based try-on methods have shown promising results by leveraging large-scale pseudo data, extending this paradigm to videos remains difficult, as constructing video-level pseudo data is prohibitively expensive. Furthermore, coarse keyframe sampling and the scarcity of multi-view try-on data limit existing keyframe-driven methods in maintaining garment consistency and handling diverse try-on tasks. To address these challenges, we propose BooM-VVT, a mask-free VVT framework built upon the keyframe-driven paradigm. To achieve mask-free VVT, we introduce a multi-stage training strategy that leverages image-level pseudo data for mask-free localization learning, substantially reducing the need for costly video-level pseudo data. To improve garment consistency, we propose Garment-Sensitive Keyframe Sampling, which selects keyframes based on garment-relevant body regions to better capture garment appearance. We further introduce Frame-Shared 3D-RoPE to establish spatiotemporal correspondences between keyframes and target video frames for accurate garment-detail transfer. Finally, we construct OmniView, a large-scale multi-view try-on dataset to support reliable try-on video generation under complex camera viewpoints and diverse try-on tasks. Extensive experiments demonstrate that BooM-VVT achieves superior temporal consistency and garment fidelity over existing methods. Project page: https://boomvvt.github.io/boomvvt.
