Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces FireRed-Image-Edit, a diffusion transformer for instruction-based image editing, achieving SOTA performance through innovations in data curation, training methodology, and evaluation. They construct a 1.6B-sample training corpus, rigorously cleaned and filtered to 100M high-quality samples, and employ a multi-stage training pipeline incorporating pre-training, supervised fine-tuning, and reinforcement learning. Key innovations include a Multi-Condition Aware Bucket Sampler, Stochastic Instruction Alignment, Asymmetric Gradient Optimization for DPO, DiffusionNFT, and a differentiable Consistency Loss, validated on a new benchmark, REDEdit-Bench, and existing benchmarks.
Instruction-based image editing just got a whole lot better: FireRed-Image-Edit leapfrogs existing systems with a massive, meticulously curated dataset and a suite of training innovations.
We present FireRed-Image-Edit, a diffusion transformer for instruction-based image editing that achieves state-of-the-art performance through systematic optimization of data curation, training methodology, and evaluation design. We construct a 1.6B-sample training corpus, comprising 900M text-to-image and 700M image editing pairs from diverse sources. After rigorous cleaning, stratification, auto-labeling, and two-stage filtering, we retain over 100M high-quality samples balanced between generation and editing, ensuring strong semantic coverage and instruction alignment. Our multi-stage training pipeline progressively builds editing capability via pre-training, supervised fine-tuning, and reinforcement learning. To improve data efficiency, we introduce a Multi-Condition Aware Bucket Sampler for variable-resolution batching and Stochastic Instruction Alignment with dynamic prompt re-indexing. To stabilize optimization and enhance controllability, we propose Asymmetric Gradient Optimization for DPO, DiffusionNFT with layout-aware OCR rewards for text editing, and a differentiable Consistency Loss for identity preservation. We further establish REDEdit-Bench, a comprehensive benchmark spanning 15 editing categories, including newly introduced beautification and low-level enhancement tasks. Extensive experiments on REDEdit-Bench and public benchmarks (ImgEdit and GEdit) demonstrate competitive or superior performance against both open-source and proprietary systems. We release code, models, and the benchmark suite to support future research.