Search papers, labs, and topics across Lattice.
This paper introduces LingT2I, a benchmark designed to evaluate cross-lingual performance in text-to-image generation across 10 languages and 33,000 prompts. The authors conduct a thorough analysis revealing significant linguistic inequalities and trade-offs that affect content generation and text rendering, highlighting the influence of cultural contexts on model outputs. Their findings underscore the necessity for more inclusive models that account for language-specific effects, paving the way for future research in multilingual T2I generation.
Language-dependent biases in text-to-image generation reveal significant gaps in model performance across different cultures and languages.
Text-to-image (T2I) generation has achieved remarkable progress in recent years. However, existing research has largely focused on English-only settings, leaving cross-lingual performance gaps and language-specific effects insufficiently explored. To fill this gap, we introduce LingT2I, a benchmark covering 10 widely used languages with 33K prompts, designed to evaluate cross-lingual effects in both content generation and text rendering. Building on this benchmark, we conduct a comprehensive cross-lingual analysis, uncovering linguistic inequality and language-dependent trade-offs across evaluation dimensions. Beyond quantitative evaluation, we further reveal a range of language-dependent generation patterns, highlighting how linguistic factors and their corresponding cultural contexts systematically impact model outputs. Our benchmark and analysis provide a foundation for studying cross-lingual behavior in T2I generation and facilitate the development of more robust and inclusive models. Code and dataset are available at https://github.com/RISys-Lab/LingT2I.
