Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Microsoft Research
Tsinghua AIFudanNankai UniversitySJTUSydneyUniversity of Science and TechnologyWaterlooOct 8, 2026arXiv:2610.12229VibeEdit introduces a novel image editing paradigm that leverages spatial marks and short notes directly on the image canvas to specify edit targets and desired changes, bypassing the ambiguity of text-only prompts for object identification. This approach enables precise control over operations like addition, removal, replacement, and attribute modification, trained on a large dataset of 1.55 million edit pairs and optimized via region-weighted supervised fine-tuning and rubric-guided reinforcement learning. VibeEdit significantly outperforms existing text-instructed methods on a challenging benchmark, demonstrating superior edit completion and preservation of unedited regions.
Ambiguous object selection in text-guided image editing is solved by directly annotating the canvas, achieving state-of-the-art performance in complex edits.
In text-guided image editing, describing the desired change is often straightforward, but identifying the intended object or region can be cumbersome, especially when several objects look alike. We introduce a new image editing interface that lets users place spatial marks and optional short notes directly on the image. Together, these annotations form a canvas instruction that specifies where to edit and what to change. Our editor, VibeEdit, follows these instructions to perform object addition, removal, replacement, attribute modification, and movement without a separate text prompt. We construct 1.55 million source-target edit pairs with object masks and structured edit descriptions, from which we render canvas instructions during training. We adapt Qwen-Image-Edit with layer-decoupled conditioning that separately encodes source images and canvas instructions for image editing. We train the model with region-weighted supervised fine-tuning, followed by rubric-guided reinforcement learning to improve edit completion, local edit quality, and preservation of unedited regions. We evaluate VibeEdit on an independently constructed, human-curated benchmark of 419 cases emphasizing target selection among similar objects. VibeEdit achieves a VLM rubric score of 79.9 and an outside-region PSNR of 32.8 dB, compared with 67.4 and 24.0 dB for FireRed, the highest-scoring text-instructed baseline in our evaluation.