Search papers, labs, and topics across Lattice.
This paper introduces JanusMesh, a novel framework for generating 3D visual illusions that reveals different semantics from various angles without the need for extensive training. By employing a cross-space dual-branch denoising process and a view-conditioned texture synthesis module, the method achieves seamless geometric fusion and high-quality texture application. Experiments show that JanusMesh generates realistic dual-semantic 3D illusions in just 3-5 minutes, outperforming traditional optimization-based and naive stitching methods in both efficiency and visual fidelity.
Achieving dual-semantic 3D visual illusions in mere minutes, JanusMesh outshines traditional methods in both speed and quality.
Creating 3D visual illusions, a single 3D mesh that reveals entirely different semantics from various viewing angles, is a fascinating but tough challenge. Existing optimization-based methods are slow and can produce oversaturated colors. In contrast, naive stitching approaches fail to produce geometrically coherent objects. This results in visible unnatural seams and semantic leaks. In this paper, we present a fast and training-free framework for generating text-driven 3D visual illusions. Our approach decouples the generation into two stages. First, we propose a cross-space dual-branch denoising process. This process dynamically decodes 3D latents into voxel space for CLIP-guided orientation alignment and Signed Distance Field (SDF) blending, which ensures seamless geometric fusion. Second, we introduce a view-conditioned texture synthesis module that projects and aggregates view-specific 2D diffusion priors onto the fused geometry. Extensive experiments demonstrate that our method generates highly realistic, dual-semantic 3D illusions in just 3-5 minutes. It significantly outperforms existing methods in geometric integrity, semantic recognizability, and efficiency. Project page: https://siang1105.github.io/JanusMesh.github.io/
