Search papers, labs, and topics across Lattice.
This paper introduces Canvas360, a two-stage framework for in-context panoramic generation that leverages geometry-aware pretraining and task-specific fine-tuning. To tackle the scarcity of high-quality training data for panoramic tasks, the authors created the Canvas360Dataset, comprising 1 million paired panoramic samples for various applications like style transfer and inpainting. Experimental results demonstrate that Canvas360 significantly enhances panoramic image fidelity and outperforms existing methods in both task coverage and modeling flexibility, particularly excelling on the panorama-specific FAED metric.
Canvas360 achieves a new standard in panoramic image generation by integrating geometry-aware pretraining with a massive dataset, leading to unprecedented fidelity and versatility in outputs.
In this work, we present Canvas360, a two-stage framework for in-context panoramic generation that combines geometry-aware pretraining with downstream task-specific fine-tuning. To address the lack of large-scale, high-quality training data tailored to in-context panoramic tasks, we propose Canvas360Dataset, a collection of 1M high-quality paired panoramic samples for style transfer, inpainting, outpainting, and editing, enabling effective supervision across diverse in-context generation scenarios. On the modeling side, Canvas360 enhances text-to-panorama generation through parallel depth generation, velocity circular padding, and similarity loss regularization, enabling the model to learn geometry-aware representations, capture object distortion details, and improve geometric consistency and global coherence. Furthermore, empowered by strong panoramic priors, Canvas360 enables a unified in-context panoramic generation framework that supports diverse downstream tasks via token-level concatenation, surpassing prior methods in both task coverage and modeling flexibility. Extensive experiments show that Canvas360 improves panoramic image fidelity, achieving particularly strong performance on the panorama-specific FAED metric and competitive or leading results across the reported quantitative evaluations. More information can be found on our project page: https://zry000.github.io/Canvas360/