Search papers, labs, and topics across Lattice.
This paper introduces CoFi-UCGen, a novel coarse-to-fine framework for unsupervised conditional image generation that disentangles global semantics from fine-grained variations without relying on labeled data. The authors propose an adversarial semantic reciprocal learning theory to maintain semantic consistency between images and latent spaces, and utilize bit-codes to structure a coarse-grained latent space while allowing for independent noise sampling. Experimental results show that CoFi-UCGen significantly outperforms existing methods in image quality, semantic consistency, and control accuracy, marking a breakthrough in label-free conditional generation techniques.
Achieving high-quality unsupervised conditional image generation without any labeled data, CoFi-UCGen sets a new standard in the field.
Unsupervised conditional image generation (UCGen) aims to control generation without relying on manually annotated labels, yet remains challenging due to unstructured semantic representations across granularities. To address this, we propose a novel coarse-to-fine UCGen framework (CoFi-UCGen) that explicitly disentangles global semantics from fine-grained variations, which to the best of our knowledge, sets out the first successful attempt for both coarse- and fine-grained conditional generation without any labels. More specifically, we first propose the adversarial semantic reciprocal learning theory to ensure the semantic consistency and completeness between images and latent spaces. Based on the consistency, we propose the bit-codes to learn a structured coarse-grained latent space, and further prove distinct global semantics inherent from our bit-codes while preserving independent noise sampling for generation. Building upon these bit-codes, we establish a fine-grained semantic basis and introduce a hierarchical modulation mechanism in diffusion models, by enabling layer-wise injection from coarse conditions to progressively control fine-grained attributes during generation. Extensive experiments demonstrate that without any label priors or pre-trained feature extractors, our CoFi-UCGen consistently outperforms existing UCGen methods in terms of image quality, semantic consistency, and control accuracy, verifying the effectiveness of explicit coarse-to-fine semantic decomposition for the challenging UCGen task.
