Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces TextPecker, a reinforcement learning strategy designed to improve visual text rendering (VTR) by addressing structural anomalies in generated text. They created a character-level structural anomaly annotated dataset, expanded with a stroke-editing synthesis engine, to train a reward function that is more sensitive to structural errors than existing MLLMs or OCR models. Applying TextPecker to existing text-to-image models, including Qwen-Image, resulted in significant improvements in structural fidelity (4%) and semantic alignment (8.7%) for Chinese text rendering, demonstrating its effectiveness in mitigating noisy reward signals.
Even state-of-the-art text-to-image models like Qwen-Image can be significantly improved in structural fidelity and semantic alignment of rendered text using a novel RL strategy that rewards structural anomaly quantification.
Visual Text Rendering (VTR) remains a critical challenge in text-to-image generation, where even advanced models frequently produce text with structural anomalies such as distortion, blurriness, and misalignment. However, we find that leading MLLMs and specialist OCR models largely fail to perceive these structural anomalies, creating a critical bottleneck for both VTR evaluation and RL-based optimization. As a result, even state-of-the-art generators (e.g., SeedDream4.0, Qwen-Image) still struggle to render structurally faithful text. To address this, we propose TextPecker, a plug-and-play structural anomaly perceptive RL strategy that mitigates noisy reward signals and works with any textto-image generator. To enable this capability, we construct a recognition dataset with character-level structural-anomaly annotations and develop a stroke-editing synthesis engine to expand structural-error coverage. Experiments show that TextPecker consistently improves diverse text-to-image models; even on the well-optimized Qwen-Image, it significantly yields average gains of 4% in structural fidelity and 8.7% in semantic alignment for Chinese text rendering, establishing a new state-of-the-art in high-fidelity VTR. Our work fills a gap in VTR optimization, providing a foundational step towards reliable and structural faithful visual text generation.