Search papers, labs, and topics across Lattice.
This paper introduces GDB-Reward, a novel framework that converts diverse graphic design evaluation metrics into reinforcement learning rewards to optimize text-to-image models for graphic design tasks. The approach addresses the challenge of non-differentiable generation processes by leveraging scalar rewards derived from existing design metrics, enabling effective training without fine-tuning the underlying image generator. Experiments show that GDB-Reward significantly enhances compliance with design specifications, improving perceptual quality, rendering fidelity, and spatial accuracy while keeping the image generator frozen.
Transforming graphic design evaluation metrics into reinforcement learning rewards could revolutionize how we optimize text-to-image models for design tasks.
Text-to-image models excel at natural image synthesis but struggle with graphic design, where success depends on satisfying precise constraints on typography, layout, color, and visual communication. While prompt optimization offers an attractive alternative to expensive diffusion model fine-tuning, learning prompts for frozen image generators requires informative reward functions despite the entirely non-differentiable generation process. Reinforcement learning does not require differentiable objectives; it requires only scalar rewards capable of ranking candidate outputs. This raises a simple question: can design evaluation metrics themselves become reinforcement learning rewards? Our central contribution is GDB-Reward, a framework that systematically transforms heterogeneous graphic design evaluation metrics into a unified reinforcement learning reward. Experiments demonstrate that GDB-Reward provides an effective optimization objective, substantially improving adherence to the design specification in perceptual quality, rendering fidelity, and spatial accuracy while keeping the image generator entirely frozen. More broadly, our results demonstrate that heterogeneous, non-differentiable evaluation metrics can move beyond passive benchmarking to become effective optimization objectives for reinforcement learning in domains where differentiable supervision is unavailable.
