Search papers, labs, and topics across Lattice.
This paper introduces MIE-Bench, the first large-scale benchmark for multi-source image editing (MIE) that includes 3,000 editing instances across 16 tasks, addressing the gap in existing evaluation methods that focus primarily on single-image editing. The authors also propose MIEScore, a multimodal large language model (MLLM)-based evaluation model that utilizes skill optimization and multi-dimensional supervised fine-tuning to align with human preferences in MIE tasks. Experimental results demonstrate that MIEScore not only achieves state-of-the-art performance in human alignment but also generalizes effectively across various image editing quality assessment datasets.
MIEScore aligns human preferences in multi-source image editing, outperforming existing benchmarks and setting a new standard for evaluation in this complex domain.
Recent advances in unified multimodal models have significantly improved text-guided image editing abilities. In particular, models such as Nano-Banana-Pro and GPT-Image-2 demonstrate emerging capabilities in multi-source image editing (MIE), including tasks such as object synthesis, person-background composition, and cross-image style fusion. However, existing benchmarks and image editing assessment (IEQA) methods remain primarily focused on single-image editing tasks and largely overlook the more challenging setting of MIE. This highlights the urgent need for a comprehensive and human-aligned benchmark for MIE. To this end, we introduce MIE-Bench, the first large-scale multiple image editing benchmark with fine-grained human preference annotations. Specifically, MIE-Bench includes 3,000 editing instances across 16 tasks, each involving more than two source images and an editing prompt, together with 36K edited images produced by 12 state-of-the-art editing models and over 108K mean opinion scores (MOSs) covering visual quality, instruction following, and attribute preservation. Based on MIE-Bench, we propose MIEScore, a multimodal large language model (MLLM)-based evaluation model enhanced with skill optimization and multi-dimensional supervised fine-tuning, to provide human-aligned feedback for MIE. Extensive experiments show that MIEScore achieves state-of-the-art performance in aligning with human preferences and generalizes well across other IEQA datasets. Both the dataset and the model are available at https://github.com/IntMeGroup/MIEScore.
