Search papers, labs, and topics across Lattice.
This paper introduces a curriculum learning strategy for self-supervised pretraining of Earth observation models that ranks samples based on geographic isolation, leveraging geolocation metadata without requiring image decoding or manual annotation. The method significantly reduces training costs, achieving baseline performance with only 20-40% of the training budget while enhancing downstream task performance by up to 5 mAP on BigEarthNet. Additionally, the analysis shows that models trained with this curriculum develop more efficient and uniformly utilized embedding spaces, indicating improved representation learning.
Training on geographically isolated samples can cut costs by over 140x while boosting model performance across multiple Earth observation tasks.
Self-supervised pretraining on remote sensing imagery typically treats all samples as equally informative, despite large variability in geographic and visual structure. We propose a curriculum learning strategy for self-supervised Earth observation that ranks samples by geographic isolation, a label-free proxy derived entirely from geolocation metadata already present in geospatial datasets, requiring no image decoding, no model feedback, and no manual annotation. Unlike visual complexity proxies, it scales as O(D log D) with dataset size D and is well-defined for both contrastive and reconstructive objectives. We integrate the proposed measure into MoCoV2 and MAE pretraining and evaluate across three downstream tasks from CopernicusBench (BigEarthNet, DFC-2020, LCZ). Our curriculum reaches baseline final-epoch performance using as few as 20% of the training budget (MAE) and at most 40% (MoCo) of the training budget, and improves final downstream performance by up to +5 mAP on BigEarthNet, with gains of 1-5 points across benchmarks, matching visual-complexity curricula while reducing pre-computation cost by more than 140x (4 s vs. 568 s on SSL4EO). A CKA and effective-rank analysis further reveals that curriculum-trained encoders develop higher-dimensional, more uniformly utilized embedding spaces throughout training.
