Search papers, labs, and topics across Lattice.
The paper introduces GeoDiT, a diffusion transformer for generating satellite images conditioned on text descriptions associated with specific geographic point locations. This approach overcomes limitations of existing methods that rely on pixel-level map conditioning by using a novel point-based conditioning framework, enabling more flexible and annotation-friendly control. The authors demonstrate that GeoDiT, incorporating an adaptive local attention mechanism, achieves state-of-the-art performance in satellite image generation.
Ditch the pixel maps: GeoDiT lets you generate high-quality satellite imagery by simply specifying points and associated text descriptions.
We introduce GeoDiT, a diffusion transformer designed for text-to-satellite image generation with point-based control. Existing controlled satellite image generative models often require pixel-level maps that are time-consuming to acquire, yet semantically limited. To address this limitation, we introduce a novel point-based conditioning framework that controls the generation process through the spatial location of the points and the textual description associated with each point, providing semantically rich control signals. This approach enables flexible, annotation-friendly, and computationally simple inference for satellite image generation. To this end, we introduce an adaptive local attention mechanism that effectively regularizes the attention scores based on the input point queries. We systematically evaluate various domain-specific design choices for training GeoDiT, including the selection of satellite image representation for alignment and geolocation representation for conditioning. Our experiments demonstrate that GeoDiT achieves impressive generation performance, surpassing the state-of-the-art remote sensing generative models.
