Search papers, labs, and topics across Lattice.
GlyphBanana tackles the challenge of precise text and formula rendering in text-to-image models by introducing an agentic workflow that leverages auxiliary tools to inject glyph templates into the latent space and attention maps. This training-free approach enhances instruction-following capabilities, particularly for out-of-distribution prompts involving complex characters and formulas. Experiments demonstrate that GlyphBanana achieves superior precision compared to existing baselines on a newly introduced benchmark for complex text rendering.
Achieve significantly more accurate text and formula rendering with a training-free agentic workflow that injects glyph templates into latent spaces and attention maps of text-to-image models.
Despite recent advances in generative models driving significant progress in text rendering, accurately generating complex text and mathematical formulas remains a formidable challenge. This difficulty primarily stems from the limited instruction-following capabilities of current models when encountering out-of-distribution prompts. To address this, we introduce GlyphBanana, alongside a corresponding benchmark specifically designed for rendering complex characters and formulas. GlyphBanana employs an agentic workflow that integrates auxiliary tools to inject glyph templates into both the latent space and attention maps, facilitating the iterative refinement of generated images. Notably, our training-free approach can be seamlessly applied to various Text-to-Image (T2I) models, achieving superior precision compared to existing baselines. Extensive experiments demonstrate the effectiveness of our proposed workflow. Associated code is publicly available at https://github.com/yuriYanZeXuan/GlyphBanana.
