Search papers, labs, and topics across Lattice.
The paper introduces CoCoEdit, a post-training framework using region-regularized reinforcement learning to improve content consistency in image editing with large generative models. They augment existing datasets with refined instructions and masks to create a 40K sample training set and introduce a pixel-level similarity reward alongside MLLM-based rewards. By incorporating a region-based regularizer that preserves non-edited regions for high-reward samples and encourages editing effects for low-reward samples, CoCoEdit achieves state-of-the-art editing quality and significantly improved content consistency, as measured by PSNR/SSIM and human evaluation.
Achieve content-consistent image edits without sacrificing quality by using region-regularized reinforcement learning that preserves unedited regions.
Image editing has achieved impressive results with the development of large-scale generative models. However, existing models mainly focus on the editing effects of intended objects and regions, often leading to unwanted changes in unintended regions. We present a post-training framework for Content-Consistent Editing (CoCoEdit) via region regularized reinforcement learning. We first augment existing editing datasets with refined instructions and masks, from which 40K diverse and high quality samples are curated as training set. We then introduce a pixel-level similarity reward to complement MLLM-based rewards, enabling models to ensure both editing quality and content consistency during the editing process. To overcome the spatial-agnostic nature of the rewards, we propose a region-based regularizer, aiming to preserve non-edited regions for high-reward samples while encouraging editing effects for low-reward samples. For evaluation, we annotate editing masks for GEdit-Bench and ImgEdit-Bench, introducing pixel-level similarity metrics to measure content consistency and editing quality. Applying CoCoEdit to Qwen-Image-Edit and FLUX-Kontext, we achieve not only competitive editing scores with state-of-the-art models, but also significantly better content consistency, measured by PSNR/SSIM metrics and human subjective ratings.
