Search papers, labs, and topics across Lattice.
This paper introduces the S2CO-Anagram model, which enhances visual anagram synthesis by integrating a structure-semantic co-optimization (S2CO) framework that improves visual quality and semantic fidelity while minimizing computational costs. The authors adapt a parallel denoising algorithm from text-to-image diffusion models to a latent-based approach, resulting in significant improvements in image resolution and aesthetic quality. Key innovations include null-text structure alignment, semantic enhancement, and attention-guided noise fusion, leading to faster inference speeds and superior output compared to existing state-of-the-art methods.
Achieving higher-resolution visual anagrams with enhanced aesthetic quality and faster generation speeds could revolutionize digital art creation.
Visual anagram is an intriguing form of art creation wherein a single image presents different conceptual interpretations under transformations such as flipping or rotation. Recent work has achieved visual anagram synthesis by leveraging pretrained text-to-image (T2I) diffusion models, yet still suffers from several key limitations including computational inefficiency, suboptimal aesthetic quality, and weak semantic fidelity and expressiveness. This work focuses on generating visual anagrams with substantially improved visual quality at minimal computational cost, thereby advancing intelligent creation of illusionary digital art. To increase image resolution while reducing time overhead, we adapt the cutting-edge parallel denoising algorithm from pixel-based T2I model to the adversarially distilled latent-based one, and accordingly propose a structure-semantic co-optimization (S2CO) framework to counteract the consequent visual degradation. As the core of our approach, S2CO framework comprises three key innovations: (\romannumeral1) null-text structure alignment optimization; (\romannumeral2) semantic enhancement optimization; (\romannumeral3) attention-guided noise fusion. Building upon these components, our method dubbed \textbf{S2CO-Anagram} is able to generate higher-resolution anagram images with noticeably superior visual harmony and semantic faithfulness than related SOTA approaches, all while achieving substantially faster inference speed. Code will be publicly available.
