Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DuET, a novel inference method that enhances diffusion image editing by temporarily relaxing source-image conditioning during the denoising process. By transitioning through a text-to-image phase, DuET allows for more natural and relevant edits while maintaining structural integrity, resulting in improved instruction relevance, semantic fidelity, and perceptual quality across various models. Notably, this approach achieves these enhancements without altering model weights or increasing sampling costs, although it does present a trade-off between source-image preservation and edit fidelity.
Relaxing source-image conditioning during diffusion editing can significantly boost the quality and relevance of generated images without the need for retraining models.
Recent diffusion editors perform diverse instruction-based edits while conditioning on the source image at every denoising step. Yet persistent source-image conditioning can limit how fully an edit is executed and how natural the result appears, especially when the target scene diverges substantially from the input. We introduce DuET (Dual Expert Trajectories), a training-free inference method that temporarily relaxes source-image conditioning by transitioning through a text-to-image phase before returning to edit mode, allowing the denoising trajectory to move toward the target distribution while retaining the structural benefits of image-conditioned editing. Without modifying model weights or increasing sampling cost, DuET consistently improves instruction relevance, semantic fidelity, and perceptual quality across diverse models and benchmarks. In some cases, these gains come with a modest reduction in source-image preservation, revealing a predictable trade-off between source preservation and edit fidelity.