Search papers, labs, and topics across Lattice.
This paper introduces PosterText, a unified model designed for e-commerce poster generation and editing by treating text patches as atomic units. The approach addresses the limitations of existing methods that either focus on end-to-end generation or multi-stage pipelines, enabling flexible operations such as addition, deletion, and modification of text patches with reference-guided style control. Extensive experiments show that PosterText outperforms current generation and editing techniques, highlighting its effectiveness in producing high-quality, editable posters.
Unified text patch manipulation in e-commerce posters could revolutionize how brands create and customize visual content.
Automated e-commerce poster design requires both high-quality poster generation and flexible editing of existing designs. However, most existing methods either target end-to-end poster generation or follow multi-stage design pipelines, with limited capability for flexible and precise editing of existing posters. To enable unified generation and editing of e-commerce posters, we introduce Text Patch Generation and Editing, a unified task formulation that treats text patches as atomic units and covers four operations: poster generation, patch addition, patch deletion, and patch modification, with optional reference-guided style control. Based on this, we propose PosterText, a unified model trained with a four-stage curriculum, including text rendering pretraining, instruction-following training, reinforcement learning for preference alignment, and spatial guidance self-distillation for execution refinement. We further construct a large-scale dataset with patch-level annotations and a comprehensive benchmark for evaluation. Extensive experiments demonstrate that PosterText achieves competitive performance against existing generation and editing approaches, validating the effectiveness of the proposed framework.
