Search papers, labs, and topics across Lattice.
The paper introduces VietFashion, a benchmark designed for sketch-text composed image retrieval focused on the Ao Dai, a traditional Vietnamese garment, addressing the inadequacy of standard AI models in capturing the nuanced cultural details of such outfits. By combining hand-drawn sketches with textual descriptions, the dataset facilitates the retrieval of culturally significant garments and is expanded to over 21,000 photorealistic images with aligned captions. Experimental evaluations highlight substantial performance gaps in existing models regarding fine-grained cultural semantics and multi-modal composition, establishing VietFashion as a critical resource for advancing fashion retrieval systems.
VietFashion reveals that current AI models struggle to capture the intricate cultural semantics of traditional garments, exposing significant gaps in fine-grained retrieval capabilities.
Cultural garments pose a unique challenge for visual retrieval systems, as their identity often depends on subtle structural and symbolic details that are poorly captured by standard AI models. We introduce VietFashion, a new benchmark for sketch-text composed image retrieval centered on the Ao Dai, a traditional Vietnamese garment. VietFashion enables designers and researchers to retrieve culturally meaningful outfits using a combination of hand-drawn sketches, which convey garment structure, and textual descriptions, which encode cultural semantics. The dataset is initialized with 650 sketches and expanded using generative models to produce over 21,000 photorealistic images with aligned captions. Textual prompts that describe detailed outfit attributes, which are extracted from fashion magazines to ensure authenticity and diversity. To better reflect the inherent ambiguity of design intent, VietFashion adopts a multi-target retrieval setting, where a single query may correspond to multiple valid results. We establish standardized evaluation protocols and benchmark state-of-the-art composed image retrieval methods. Experimental results reveal significant performance gaps in modeling fine-grained cultural semantics and multi-modal composition, positioning VietFashion as a challenging benchmark for fine-grained fashion retrieval. The dataset is publicly available at: https://hng0303.github.io/VietFashion.
