Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel conditioning framework for diffusion models that effectively separates common and salient factors in data distributions, addressing limitations in existing generative models like VAEs and GANs. By training a prompt-free, image-conditioned diffusion model and employing weak supervision for factor decomposition, the authors achieve high-fidelity image generation while maintaining the integrity of latent factor separation. The key result demonstrates that the proposed additive contrastive factorization is identifiable under mild conditions, enabling precise manipulation of salient factors through operations such as swapping and interpolation.
Achieving high-fidelity image generation while successfully separating common and salient factors could revolutionize how we manipulate and understand complex data distributions.
Contrastive Analysis aims to separate factors that are common between two data distributions from those that are salient to only one of them. Existing contrastive methods are based on generative models (e.g., VAEs or GANs) that often suffer from limited reconstruction and image quality, which hampers effective latent factor separation and limits their applicability to high-fidelity image generation and edition. We propose a novel conditioning framework for diffusion models that enables contrastive decomposition without compromising generation quality. We first train a prompt-free, image-conditioned diffusion model, and then learn to decompose the conditioning into a common and a salient factor, using weak supervision. We prove that the additive contrastive factorization, commonly assumed in prior work, is identifiable under mild conditions. This factorization enables targeted operations by swapping or interpolating only the salient factor.