Search papers, labs, and topics across Lattice.
The paper introduces CoCoDiff, a training-free style transfer framework that leverages pretrained latent diffusion models to achieve fine-grained, semantically consistent stylization by explicitly modeling correspondence cues. CoCoDiff constructs a dense alignment map between content and style images using a pixel-wise semantic correspondence module that mines intermediate diffusion features. The framework further enforces structural and perceptual alignment across iterations using a cycle-consistency module, leading to improved object and region-level stylization.
Achieve state-of-the-art style transfer without any training by exploiting under-explored correspondence cues within pre-trained diffusion models.
Transferring visual style between images while preserving semantic correspondence between similar objects remains a central challenge in computer vision. While existing methods have made great strides, most of them operate at global level but overlook region-wise and even pixel-wise semantic correspondence. To address this, we propose CoCoDiff, a novel training-free and low-cost style transfer framework that leverages pretrained latent diffusion models to achieve fine-grained, semantically consistent stylization. We identify that correspondence cues within generative diffusion models are under-explored and that content consistency across semantically matched regions is often neglected. CoCoDiff introduces a pixel-wise semantic correspondence module that mines intermediate diffusion features to construct a dense alignment map between content and style images. Furthermore, a cycle-consistency module then enforces structural and perceptual alignment across iterations, yielding object and region level stylization that preserves geometry and detail. Despite requiring no additional training or supervision, CoCoDiff delivers state-of-the-art visual quality and strong quantitative results, outperforming methods that rely on extra training or annotations.
