Search papers, labs, and topics across Lattice.
The paper introduces NGL-Prompter, a training-free pipeline that leverages large vision language models (VLMs) to estimate sewing patterns from single images by using a novel intermediate language (NGL) to bridge the gap between image understanding and structured garment parameters. NGL restructures GarmentCode into a format more amenable to VLMs, enabling the extraction of structured garment parameters through prompting. The method achieves state-of-the-art performance on geometry metrics and perceptual evaluations, demonstrating strong generalization to real-world images and multi-layer outfits without requiring model training.
Accurate sewing patterns from images, without any training? This new method uses VLMs and a clever intermediate language to unlock garment reconstruction from real-world images.
Estimating sewing patterns from images is a practical approach for creating high-quality 3D garments. Due to the lack of real-world pattern-image paired data, prior approaches fine-tune large vision language models (VLMs) on synthetic garment datasets generated by randomly sampling from a parametric garment model GarmentCode. However, these methods often struggle to generalize to in-the-wild images, fail to capture real-world correlations between garment parts, and are typically restricted to single-layer outfits. In contrast, we observe that VLMs are effective at describing garments in natural language, yet perform poorly when asked to directly regress GarmentCode parameters from images. To bridge this gap, we propose NGL (Natural Garment Language), a novel intermediate language that restructures GarmentCode into a representation more understandable to language models. Leveraging this language, we introduce NGL-Prompter, a training-free pipeline that queries large VLMs to extract structured garment parameters, which are then deterministically mapped to valid GarmentCode. We evaluate our method on the Dress4D, CloSe and a newly collected dataset of approximately 5,000 in-the-wild fashion images. Our approach achieves state-of-the-art performance on standard geometry metrics and is strongly preferred in both human and GPT-based perceptual evaluations compared to existing baselines. Furthermore, NGL-prompter can recover multi-layer outfits whereas competing methods focus mostly on single-layer garments, highlighting its strong generalization to real-world images even with occluded parts. These results demonstrate that accurate sewing pattern reconstruction is possible without costly model training. Our code and data will be released for research use.
