Search papers, labs, and topics across Lattice.
PromptEcho is introduced as a novel reward construction method for text-to-image reinforcement learning that leverages frozen vision-language models (VLMs) to provide dense, annotation-free reward signals. It computes token-level cross-entropy loss between the original prompt and the generated image using a frozen VLM, effectively extracting image-text alignment knowledge. Experiments on DenseAlignBench and other benchmarks demonstrate significant improvements in prompt following capability for Z-Image and QwenImage-2512, outperforming inference-based scoring and scaling with VLM size.
Skip the costly human annotations: PromptEcho distills reward signals directly from frozen VLMs to boost text-to-image RL, achieving state-of-the-art results without any reward model training.
Reinforcement learning (RL) can improve the prompt following capability of text-to-image (T2I) models, yet obtaining high-quality reward signals remains challenging: CLIP Score is too coarse-grained, while VLM-based reward models (e.g., RewardDance) require costly human-annotated preference data and additional fine-tuning. We propose PromptEcho, a reward construction method that requires \emph{no} annotation and \emph{no} reward model training. Given a generated image and a guiding query, PromptEcho computes the token-level cross-entropy loss of a frozen VLM with the original prompt as the label, directly extracting the image-text alignment knowledge encoded during VLM pretraining. The reward is deterministic, computationally efficient, and improves automatically as stronger open-source VLMs become available. For evaluation, we develop DenseAlignBench, a benchmark of concept-rich dense captions for rigorously testing prompt following capability. Experimental results on two state-of-the-art T2I models (Z-Image and QwenImage-2512) demonstrate that PromptEcho achieves substantial improvements on DenseAlignBench (+26.8pp / +16.2pp net win rate), along with consistent gains on GenEval, DPG-Bench, and TIIFBench without any task-specific training. Ablation studies confirm that PromptEcho comprehensively outperforms inference-based scoring with the same VLM, and that reward quality scales with VLM size. We will open-source the trained models and the DenseAlignBench.
DAMO