Search papers, labs, and topics across Lattice.
FLORO, a multimodal geospatial foundation model, is introduced to learn transferable representations from diverse remote sensing data, addressing limitations of existing models that require large datasets and fixed sensor configurations. The model uses masked autoencoding on a combination of Sentinel-1, Sentinel-2, SkySAT imagery, elevation, and UAV data, incorporating availability-aware inputs to handle sensor variability. Evaluated on the PANGAEA benchmark, FLORO demonstrates strong transfer learning performance across various tasks and sensor types, achieving competitive results with models trained on significantly larger datasets.
You don't need massive datasets to build effective remote sensing foundation models; FLORO achieves competitive performance with models trained on 100x more data.
Foundation models offer a promising route to transferable remote sensing representations, but many current approaches depend on very large pretraining datasets and fixed sensor configurations, limiting their suitability for ecological and environmental applications, where observations often vary across platforms, spatial and spectral resolutions, and available modalities. We introduce FLORO, a multimodal geospatial foundation model designed to learn transferable representations from a small but highly diverse remote sensing corpus. FLORO is pretrained using masked autoencoding on a heterogeneous combination of Sentinel-1, Sentinel-2, SkySAT imagery, elevation, and UAV-derived data. To accommodate sensor variability, FLORO incorporates availability-aware inputs that indicate which spectral bands and auxiliary modalities are present in each sample, enabling a unified input space across heterogeneous sensor configurations. We evaluated FLORO on the PANGAEA benchmark under a frozen-encoder protocol across scene classification, segmentation, and regression tasks. Despite being pretrained on a smaller corpus than competing foundation models, FLORO achieved strong and stable transfer across optical, optical-SAR, and optical-elevation benchmarks spanning medium-resolution satellite, airborne, and ultra-high-resolution UAV imagery. FLORO obtained the second-best average segmentation performance across six PANGAEA benchmarks, trailing only a recently introduced foundation model pretrained on over two orders of magnitude more images, remained competitive on scene classification, and was robust in regression tasks, while qualitative results showed improved preservation of spatial structure in flood, urban, biomass, and canopy-height prediction settings. In a separate controlled experiment on EuroSAT-MS, geo-positional encoding further improved classification relative to absolute positional encoding.
