Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors introduce EditHF-1M, a large-scale dataset containing over 29M human preference pairs and 148K mean opinion scores for text-guided image edits, evaluated across visual quality, instruction alignment, and attribute preservation. They then develop EditHF, a multimodal LLM-based evaluation model trained on EditHF-1M, which demonstrates strong alignment with human preferences and generalization across datasets. Finally, they use EditHF as a reward signal (EditHF-Reward) to fine-tune the Qwen-Image-Edit model via reinforcement learning, achieving significant performance improvements in text-guided image editing.
Forget small-scale image editing datasets – this work unleashes a million-scale human preference dataset that unlocks better reward models and boosts text-guided image editing performance.
Recent text-guided image editing (TIE) models have achieved remarkable progress, while many edited images still suffer from issues such as artifacts, unexpected editings, unaesthetic contents. Although some benchmarks and methods have been proposed for evaluating edited images, scalable evaluation models are still lacking, which limits the development of human feedback reward models for image editing. To address the challenges, we first introduce \textbf{EditHF-1M}, a million-scale image editing dataset with over 29M human preference pairs and 148K human mean opinion ratings, both evaluated from three dimensions, \textit{i.e.}, visual quality, instruction alignment, and attribute preservation. Based on EditHF-1M, we propose \textbf{EditHF}, a multimodal large language model (MLLM) based evaluation model, to provide human-aligned feedback from image editing. Finally, we introduce \textbf{EditHF-Reward}, which utilizes EditHF as the reward signal to optimize the text-guided image editing models through reinforcement learning. Extensive experiments show that EditHF achieves superior alignment with human preferences and demonstrates strong generalization on other datasets. Furthermore, we fine-tune the Qwen-Image-Edit using EditHF-Reward, achieving significant performance improvements, which demonstrates the ability of EditHF to serve as a reward model to scale-up the image editing. Both the dataset and code will be released in our GitHub repository: https://github.com/IntMeGroup/EditHF.