Search papers, labs, and topics across Lattice.
This paper introduces a pre-training strategy that discourages learning domain-specific features during pre-training on datasets like ImageNet, with the goal of improving generalization to remote sensing image segmentation. The method involves modifying the pre-training objective to reduce reliance on dataset-specific characteristics. Experiments demonstrate state-of-the-art mean Intersection over Union (mIoU) and F1 scores on four diverse remote sensing datasets (iSAID, MFNet, PST900, and Potsdam) after fine-tuning models pre-trained with the proposed strategy.
Stop wasting time curating massive domain-specific datasets: this pre-training strategy lets you leverage ImageNet more effectively for remote sensing, achieving state-of-the-art segmentation accuracy across diverse datasets.
In the segmentation of remotely sensed images, deep learning models are typically pre-trained using large image databases like ImageNet before fine-tuned on domain-specific datasets. However, the performance of these fine-tuned models is often hindered by the large domain gaps (i.e., differences in scenes and modalities) between ImageNet's images and remotely sensed images being processed. Therefore, many researchers have undertaken efforts to establish large-scale domain-specific image datasets for pre-training, aiming to enhance model performance. However, establishing such datasets is often challenging, requiring significant effort, and these datasets often exhibit limited generaliza-bility to other application scenarios. To address these issues, this study introduces a novel yet simple pre-training strategy designed to guide a model away from learning domain-specific features in a pre-training dataset during pre-training, thereby improving the generalisation ability of the pre-trained model. To evaluate the strategy's effectiveness, deep learning models are pre-trained on ImageNet and subsequently fine-tuned on four semantic segmentation datasets with diverse scenes and modalities, including iSAID, MFNet, PST900 and Potsdam. Experimental results show that the proposed pre-training strategy led to state-of-the-art accuracies on all four datasets, namely 67.4% mIoU for iSAID, 56.9% mIoU for MFNet, 84.22% mIoU for PST900, 91.88% mF1 for Potsdam. This research lays the groundwork for developing a unified foundation model applicable to both computer vision and remote sensing applications.
