Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
GlyphAnchor addresses the challenges of rendering accurate text in image generation and editing by introducing position-anchored glyph priors that enhance existing models. This method leverages lightweight glyph patch conditions aligned with the model's native positional encoding, improving robustness through staged supervised finetuning and text-aware post-training. Experimental results demonstrate that GlyphAnchor significantly enhances text fidelity in complex scenarios while maintaining high image quality across various benchmarks and backbones.
GlyphAnchor achieves unprecedented text fidelity in image generation, even with complex and rare characters, by anchoring glyphs to their positions in the target image.
Rendering accurate text remains difficult for image generation and editing models, especially when the target contains long, complex, and densely arranged text or rare characters. Existing approaches either improve native text rendering through stronger backbones and data-centric training without explicit glyph priors, or incorporate glyph priors through specialized designs that remain insufficiently accurate and robust under challenging scenarios. We introduce GlyphAnchor, a novel text-rendering enhancement method for both text-to-image and image-editing diffusion transformer models. GlyphAnchor enhances the backbone with lightweight glyph patch conditions whose positions are anchored to the target image through the model's native positional encoding. We train this capability with staged supervised finetuning and further refine it with text-aware post-training to improve robustness. We also introduce InfoTextBench, a benchmark for evaluating text-rich visual text rendering in both generation and editing settings. Experiments across multiple backbones and benchmarks, including long, complex, and densely arranged text and rare character scenarios, show that GlyphAnchor consistently improves text fidelity while preserving overall image quality.