Search papers, labs, and topics across Lattice.
VicoEdit, a novel training-free image editing method, directly transforms source images based on visual context, avoiding the inconsistencies of diffusion inversion. It achieves this by incorporating visual context directly into a pretrained text-prompted editing model. A concept alignment-guided posterior sampling approach further enhances editing consistency. Experiments show VicoEdit outperforms state-of-the-art training-based models, despite requiring no training.
Training-free image editing can now beat fine-tuned models, thanks to a clever way of injecting visual context and ensuring concept alignment.
In image editing, it is essential to incorporate a context image to convey the user's precise requirements, such as subject appearance or image style. Existing training-based visual context-aware editing methods incur data collection effort and training cost. On the other hand, the training-free alternatives are typically established on diffusion inversion, which struggles with consistency and flexibility. In this work, we propose VicoEdit, a training-free and inversion-free method to inject the visual context into the pretrained text-prompted editing model. More specifically, VicoEdit directly transforms the source image into the target one based on the visual context, thereby eliminating the need for inversion that can lead to deviated trajectories. Moreover, we design a posterior sampling approach guided by concept alignment to enhance the editing consistency. Empirical results demonstrate that our training-free method achieves even better editing performance than the state-of-the-art training-based models.
