Search papers, labs, and topics across Lattice.
This paper addresses the challenge of visual object consistency in text-guided image editing by introducing the ABO-Edit dataset, which contains over 12,000 curated triplets of source images, editing prompts, and high-quality target images. The authors reveal that the conditioning embedding space in rectified flow models, which is not directly supervised during training, can predict the final generated image even under high noise conditions. By leveraging this insight, they propose FlowMirror, a parameter-free auxiliary loss that enhances generation quality across multiple metrics without requiring architectural modifications.
A novel auxiliary loss, FlowMirror, significantly boosts image generation quality by harnessing the predictive power of unsupervised conditioning embeddings.
Despite remarkable progress in text-guided image editing, generative models frequently fail to preserve visual object consistency, defined as the preservation of a subject's key attributes throughout the editing process. We address this limitation through three contributions. First, we introduce ABO-Edit, a dataset specifically designed to study object consistency, comprising over 12,000 triplets of source images, editing prompts, and high-quality target images rendered from artist-designed 3D assets, with multi-view coverage and human-verified quality control. Second, we uncover an overlooked property of image-editing rectified flow models: the conditioning embedding space, not directly supervised during training, encodes a prediction of the final generated image even at high noise levels. Third, exploiting this finding, we propose FlowMirror, a parameter-free auxiliary loss that supervises this conditioning embedding space. Without architectural changes, our method improves generation quality across several metrics over baselines.
Amazon Science