Search papers, labs, and topics across Lattice.
FitVTON is a novel virtual try-on model that enhances garment fitting accuracy by incorporating body-garment size control through structured text prompts and simulated try-on triplets. By introducing auxiliary heads for mask prediction and a texture rectification stage, the model achieves superior fitting fidelity and shape preservation compared to existing methods. Evaluated on the newly curated FittingEffect3K dataset, FitVTON demonstrates significant improvements in sizing accuracy while maintaining high image quality.
FitVTON achieves authentic garment fitting across diverse body shapes, outperforming state-of-the-art methods in both sizing accuracy and visual realism.
While diffusion-based virtual try-on has achieved impressive visual realism, most methods treat the task as 2D inpainting, prioritizing texture preservation over physical plausibility. Consequently, they often produce plausible-looking images that fail to reflect authentic garment fit across diverse body shapes. We present FitVTON, a Fit-aware virtual try-on model on different bodies in the wild. FitVTON encodes garment-body size through structured text prompts, and learn from simulated try-on triplets from parameterized garment model. To improve the fitting effects over garment silhouettes, we introduce two auxiliary head to predict the masks for both the garment and the exposed body. We further introduce a texture rectification stage to improve realistic appearance from simulated data. To evaluate the fitting fidelity, we curate a real-world dataset, FittingEffect3K, combining VLM-based scoring protocol. Both subjective and quantitive experiments show that FitVTON demonstrate authentic fitting fidelity, with significant sizing accuracy and shape preservation over state-of-the-art methods while maintaining competitive image quality. Project Page: https://zenoning.github.io/FitVTON/.
Tsinghua AI