Search papers, labs, and topics across Lattice.
This paper introduces Geospatial Foundation Models (GeoFMs), which leverage extensive geospatial datasets for pre-training, enabling domain experts to fine-tune these models for specific tasks without needing deep computational resources. The authors highlight a paradigm shift that separates the responsibilities of model training and application, thus democratizing access to advanced AI/ML capabilities while ensuring task confidentiality. Key findings reveal that different GeoFMs, such as self-supervised vision models and contrastive learning-based vision-language models, unlock novel functionalities including zero-shot image analysis and advanced reasoning capabilities through Large Language Models.
GeoFMs not only democratize access to cutting-edge AI but also enable domain experts to harness advanced reasoning capabilities without extensive computational overhead.
The analysis of satellite and aerial imagery has entered a new era with the advent of foundation models. This paper describes the concept of Geospatial Foundation Models (GeoFMs), which are artificial intelligence/machine learning (AI/ML) models pre-trained on massive geospatial datasets through varied methodologies. We first articulate the core paradigm shift that GeoFMs enable: a separation of duties, where large-scale model providers perform the computationally intensive pretraining, allowing domain experts to rapidly fine-tune or prompt these models for specific, mission-critical tasks. This approach democratizes access to state-of-the-art AI/ML while maintaining the security and confidentiality of the downstream task. We then explore the novel capabilities unlocked by different types of GeoFMs, distinguishing between the finetunable vision models produced by self-supervised techniques like masked auto-encoding, and the vision-language models produced by contrastive learning which enable zero-shot tasks like open-vocabulary image analysis. Next, we discuss the practical considerations for operationalizing GeoFMs, from performance-cost analysis to the broader MLOps ecosystem. To that end, we introduce a taxonomy of model adaptation strategies and propose a framework for domain experts to select the most cost-effective adaptation approach for their particular mission set. Finally, we present a forward-looking vision of Agentic Geospatial Reasoning, where Large Language Models act as intelligent orchestrators, leveraging GeoFMs as tools to answer high-level user queries in natural language and automate complex analytical workflows, moving the field from perception to cognition.