Search papers, labs, and topics across Lattice.
This paper introduces ViCLIP-OT, a vision-language model tailored for Vietnamese image-text retrieval, addressing the limitations of existing models in low-resource languages. The model combines CLIP-style contrastive learning with a Similarity-Graph Regularized Optimal Transport (SIGROT) loss to improve cross-modal consistency. Experiments on three Vietnamese benchmarks show that ViCLIP-OT outperforms CLIP and SigLIP baselines in both in-domain and zero-shot settings, demonstrating improved alignment and reduced modality gap.
A new vision-language model closes the gap for Vietnamese image-text retrieval, outperforming standard CLIP models by over 11% in zero-shot performance.
Image-text retrieval has become a fundamental component in intelligent multimedia systems; however, most existing vision-language models are optimized for highresource languages and remain suboptimal for low-resource settings such as Vietnamese. This work introduces ViCLIP-OT, a foundation vision-language model specifically designed for Vietnamese image-text retrieval. The proposed framework integrates CLIP-style contrastive learning with a Similarity-Graph Regularized Optimal Transport (SIGROT) loss to enhance global cross-modal consistency and mitigate modality gap issues. Extensive experiments on three Vietnamese benchmarks (UITOpenViIC, KTVIC, and Crossmodal-3600) demonstrate that ViCLIP-OT consistently outperforms CLIP and SigLIP baselines in both in-domain and zero-shot settings. On UIT-OpenViIC, the model achieves an average Recall@K of 67.34%, improving upon CLIP by 5.75 percentage points. In zero-shot evaluation on Crossmodal-3600, ViCLIPOT surpasses CLIP by 11.72 percentage points. Embedding-space analysis further confirms improved alignment and reduced modality gap. The results indicate that integrating SIGROT provides an effective and scalable strategy for cross-modal retrieval in low-resource languages, offering practical implications for intelligent multimedia retrieval systems in Vietnamese and other underrepresented linguistic contexts.
