Track genomics, neuroscience and molecular biology.
Search papers, labs, and topics across Lattice.
This paper introduces SCOPE, a novel RL-based prompt engineering framework for text-to-image generation that optimizes prompt rewrites by explicitly modeling semantic structure within prompts. By pooling policy log probability shifts within identified semantic spans, SCOPE aligns update weighting with coherent units like objects, attributes, and relations, bypassing the need for separate span rewards or additional image renders. Across multiple T2I models, SCOPE significantly outperforms vanilla GRPO, demonstrating the efficacy of semantic structure as an inductive bias for RL-driven prompt engineering.
Semantic structure, not just token-level feedback, unlocks significant gains in RL-driven text-to-image prompt engineering.
Reinforcement learning (RL) enables language models to improve text-to-image (T2I) generation by rewriting prompts for a frozen image generator. Existing methods typically apply a single signal derived from the image to individual subword tokens, although objects, counts, attributes, and relations form coherent semantic spans. We propose SCOPE, an objective based on Group Relative Policy Optimization (GRPO) that aligns update weighting with this structure. The rewriter jointly generates an enhanced prompt and its semantic partition. SCOPE pools shifts in policy log probabilities within each span to derive a shared coefficient for its token losses while retaining a single advantage for each completion. It requires neither separate span rewards nor additional image renders. Across Qwen-Image, SD3, and FLUX.1-dev, SCOPE achieves average relative gains over vanilla GRPO of 9.48% on GeneVal and 7.62% on T2I-CompBench. Ablation studies show that both semantic boundaries and pooling within spans contribute to these gains, supporting semantic structure as a practical inductive bias for prompt engineering with RL.