Search papers, labs, and topics across Lattice.
The paper introduces CreatiParser, a hybrid generative framework that decomposes raster graphic designs into editable text, background, and sticker layers. It leverages a vision-language model for parsing text regions into a text rendering protocol and a multi-branch diffusion architecture for generating background and sticker layers with RGBA support. By incorporating ParserReward and Group Relative Policy Optimization, the framework aligns generation quality with human design preferences, achieving a 23.7% improvement over existing methods on Parser-40K and Crello datasets.
Decomposing rasterized graphic designs into editable layers is now significantly more faithful and controllable thanks to a hybrid generative approach that combines vision-language models and multi-branch diffusion.
Graphic design images consist of multiple editable layers, such as text, background, and decorative elements, while most generative models produce rasterized outputs without explicit layer structures, limiting downstream editing. Existing graphic design parsing methods typically rely on multi-stage pipelines combining layout prediction, matting, and inpainting, which suffer from error accumulation and limited controllability. We propose a hybrid generative framework for raster-to-layer graphic design parsing that decomposes a design image into editable text, background, and sticker layers. Text regions are parsed using a vision-language model into a text rendering protocol, enabling faithful reconstruction and flexible re-editing, while background and sticker layers are generated using a multi-branch diffusion architecture with RGBA support. We further introduce ParserReward and integrate it with Group Relative Policy Optimization to align generation quality with human design preferences. Extensive experiments on two challenging datasets, \emph{i.e.,} the Parser-40K and Crello datasets, demonstrate superior performance over existing methods, \emph{eg.,} achieving an overall average improvement of 23.7\% across all metrics.
