Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores the application of self-supervised learning (SSL) for high-resolution multispectral imagery in precision agriculture, utilizing a harmonized dataset of cm-scale UAV imagery collected over multiple years and regions. By employing Transformer-based encoders pretrained with Momentum Contrast v3 and Masked Autoencoders, the research evaluates the effectiveness of SSL in crop-weed semantic segmentation tasks across different datasets. The Swin Transformer pretrained with MoCo-v3 outperformed existing models, demonstrating significant cross-sensor and cross-region generalization, while also contributing a publicly available dataset for future studies.
Self-supervised learning can dramatically enhance the performance of multispectral UAV models, achieving superior results in crop-weed segmentation with minimal labeled data.
Although self-supervised learning (SSL) offers a promising way to reduce annotation effort in close-range remote sensing, its effectiveness for high-resolution multispectral unmanned aerial vehicle (UAV) imagery remains underexplored due to limited data. This study evaluated SSL pretraining for precision agriculture using cm-scale multispectral drone imagery collected across multiple sensors, years, and regions. Transformer-based encoders were pretrained with Momentum Contrast v3 (MoCo-v3) and Masked Autoencoders on a harmonized dataset combining msuav500K with newly collected multi-year UAV imagery from agricultural fields in Finland. Pretraining used four spectral bands (Green, Red, Red-Edge, Near-Infrared) for cross-sensor compatibility. The models were evaluated on crop-weed semantic segmentation using the WeedMap dataset with 5--100% training data. The following two subsets served as downstream tasks: Task A (Germany, RedEdge-M), where all pretrained models were compared under partial and full fine-tuning, and Task B (Switzerland, Sequoia), where the best encoder from Task A was assessed. Our Swin Transformer pretrained with MoCo-v3 achieved the strongest performance on both tasks, surpassing the Swin Transformer model of Doornbos et al. pretrained on a pre-release of msuav500K. Our pretrained Swin Transformer further demonstrated cross-sensor and cross-region generalization. We additionally provide a public multi-year multispectral UAV dataset from Finland to support future research.