Search papers, labs, and topics across Lattice.
This paper addresses the challenge of preserving product identity in instruction-based image editing by introducing the ProductConsistency dataset, which includes 87k supervised fine-tuning samples and 869 unique reinforcement learning samples. The authors implement a Cyclic Consistency reward to enhance semantic preservation during reinforcement learning training, leading to significant improvements in OCR and perceptual metrics. Notably, the Qwen-Image-Edit-2511 model achieved a fivefold reduction in character error rate, demonstrating enhanced product consistency and text rendering capabilities.
Achieving a fivefold reduction in character error rate, this work revolutionizes product-centric image editing by ensuring brand integrity and textual fidelity in generated visuals.
Recent advances in instruction-based image editing have enabled models to perform complex visual edits from natural language instructions. However, in product-centric scenarios where preserving product features, branding, and textual elements are critical, current open and closed source models often struggle to maintain this fine-grained object identity. This issue is further compounded by the lack of datasets for instruction-based product image editing with text fidelity constraints, leaving it largely treated as an implicit capability of instruction-based image editing models. In this work, we introduce the ProductConsistency dataset which is designed to improve product-centric image editing. Our approach includes a supervised fine-tuning (SFT) dataset of 87k samples for product editing, a reinforcement learning (RL) dataset with 869 unique product images, and a new benchmark dataset, the ProductConsistency Benchmark, to allow rigorous and standardized evaluation of editing models. To guide RL training, we propose a Cyclic Consistency reward that enforces semantic preservation of product identity by using caption similarity between the original product description and captions generated from the edited image. We fine-tune both Qwen-Image-Edit-2511 and Flux.1-Kontext-dev using our dataset and demonstrate consistent improvements over baseline models in OCR and Perceptual metrics, and MLLM-based evaluations as well, indicating stronger product consistency, text rendering, and overall visual quality; with the Qwen-Image-Edit-2511 model achieving a 5x reduction in the character error rate. The code and pipeline is available at https://anonymous.4open.science/r/ProductConsistency-6FCC/README.md
