Search papers, labs, and topics across Lattice.
This paper introduces SpheRoPE, a novel framework for generating 360 panoramic images and videos without the need for training or optimization, by integrating spherical priors into pre-trained diffusion transformers. The method addresses the limitations of existing approaches that either require extensive fine-tuning on limited data or incur high inference latency due to multi-step optimization. By utilizing Spherical RoPE for position encoding and a Semantic Distortion classifier-free guidance, the framework effectively adheres to the topological constraints of equirectangular projection while maintaining competitive performance across various generation modalities.
Zero-shot generation of 360 panoramas is now possible without the costly fine-tuning or optimization typically required, unlocking new creative potentials in image synthesis.
We present a zero-shot, training-free and optimization-free framework for generating 360 panoramic images and videos by directly injecting spherical priors into pre-trained diffusion transformers. Existing methods either rely on costly fine-tuning on scarce panoramic data that limits generalization, or leverage multi-step optimization that incurs prohibitive inference latency. We observe that contemporary generative models natively exhibit some panoramic priors from large-scale training. However, these emergent capabilities are insufficient, as the models fundamentally fail to satisfy the rigorous topological constraints imposed by equirectangular projection (ERP). We introduce a zero-shot and optimization-free approach that resolves these constraints at inference time. Spherical RoPE replaces standard rotary position embeddings: low-frequency channels are re-parameterized as 3D Cartesian coordinates to natively encode the spherical manifold, while high-frequency channels are harmonically quantized to enforce exact periodicity. Coupled with complementary Semantic Distortion classifier-free guidance (CFG) that explicitly steers geometry, we avoid retraining and inherit the full creative breadth of state-of-the-art models. Our approach generalizes across diverse backbones and 360 generation modalities. We demonstrate this across text-to-panorama using Flux.1, Flux.2, and LTX-Video backbones, achieving competitive performance against baselines, all while remaining training-free. Project page: https://orhir.github.io/SpheRoPE