Search papers, labs, and topics across Lattice.
This paper introduces Canvas360, a two-stage framework for in-context panoramic generation that leverages geometry-aware pretraining and task-specific fine-tuning to enhance image fidelity. The authors address the scarcity of high-quality training data by creating the Canvas360Dataset, which consists of 1 million paired panoramic samples for various tasks such as style transfer and inpainting. Experimental results demonstrate that Canvas360 significantly outperforms previous methods in both fidelity and task versatility, achieving notable improvements on the panorama-specific FAED metric.
Canvas360 not only redefines panoramic generation with geometry-aware techniques but also delivers a dataset of 1 million samples that transforms how we approach in-context tasks.
In this work, we present Canvas360, a two-stage framework for in-context panoramic generation that combines geometry-aware pretraining with downstream task-specific fine-tuning. To address the lack of large-scale, high-quality training data tailored to in-context panoramic tasks, we propose Canvas360Dataset, a collection of 1M high-quality paired panoramic samples for style transfer, inpainting, outpainting, and editing, enabling effective supervision across diverse in-context generation scenarios. On the modeling side, Canvas360 enhances text-to-panorama generation through parallel depth generation, velocity circular padding, and similarity loss regularization, enabling the model to learn geometry-aware representations, capture object distortion details, and improve geometric consistency and global coherence. Furthermore, empowered by strong panoramic priors, Canvas360 enables a unified in-context panoramic generation framework that supports diverse downstream tasks via token-level concatenation, surpassing prior methods in both task coverage and modeling flexibility. Extensive experiments show that Canvas360 improves panoramic image fidelity, achieving particularly strong performance on the panorama-specific FAED metric and competitive or leading results across the reported quantitative evaluations. More information can be found on our project page: https://zry000.github.io/Canvas360/