Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
This paper introduces UltraText Bench, a novel bilingual benchmark designed to rigorously evaluate the visual text rendering capabilities of image generation models in complex, multi-region scenarios. The benchmark comprises 432 prompts across 24 scene categories and three difficulty levels, featuring 4-12 text regions per prompt, to push beyond current limitations in short-string generation. Evaluation using the Q-Judger VLM reveals significant performance disparities across models and difficulty levels, highlighting trade-offs between text fidelity and clarity.
Current image generation models struggle with rendering dense, multi-region text, with fidelity dropping by over 14 points when clarity is prioritized.
Dense visual text requires image generators to reproduce long strings across multiple regions with correct placement and legibility. As short-string rendering improves, evaluation must test sustained performance across more demanding scenes. We introduce UltraText Bench, a bilingual benchmark for prompt-only generation of dense visual text. It contains 432 prompts spanning 24 real-world scene categories and three difficulty levels, split equally between English and Chinese. Each human-reviewed prompt supplies exact strings for four to twelve text regions, paired with structured references for their content, placement, and visual attributes. We use the Q-Judger vision-language model to assess each image against the complete reference, reporting text fidelity, text clarity, spatial quality, and scene quality. Across 24 model configurations, these dimensions reveal different strengths: Z-Image-Turbo gains 3.81 clarity points over Z-Image-Base while losing 14.76 fidelity points under the reported settings. Performance also varies with workload; Qwen-Image-2512's English composite falls from 86.50 at L1 to 42.86 at L3. Ten participants took part in human evaluation of the automatic scores. Repository: https://github.com/LINs-lab/UltraText_Bench.