Search papers, labs, and topics across Lattice.
This paper introduces a new segmentation task for ultra-wide area (UWA) remote sensing images, characterized by large pixel counts and wide geographical coverage, and proposes the Scale-Frustum Representation Network (SFR-Net) to address the challenges of varying object scales and maintaining contextual continuity. SFR-Net constructs scale-frustum representations inspired by viewing frustums at different altitudes to model objects and features at multiple scales. A cascaded cross-scale fusion mechanism then integrates these representations, achieving state-of-the-art performance on GID and FBPS datasets with mIoU improvements of 1.72% and 4.29%, respectively.
Scale-Frustum Representations offer a surprisingly effective way to model objects at drastically different scales in ultra-wide area remote sensing images, boosting segmentation accuracy and convergence speed.
Pixel count and geographical coverage are two key characteristics of remote sensing images. Existing remote sensing image segmentation methods typically focus on images with either a small pixel count or a large pixel count but limited geographical coverage. In this paper, we introduce a novel segmentation task targeting ultra-wide area (UWA) remote sensing images, characterized by both a large pixel count and extremely wide geographical coverage. The core challenges of UWA segmentation lie in simultaneously handling ground objects with significantly varying scales and maintaining long-range contextual semantic continuity. To address these challenges, we propose the Scale-Frustum Representation Network (SFR-Net). Inspired by the viewing frustums of remote sensing images captured from different altitudes, we construct scale-frustum representations, enabling unified modeling of ground objects and contextual features at different scales. Furthermore, we design a cascaded cross-scale fusion mechanism to effectively integrate these representations, enhancing local semantic understanding while ensuring long-range contextual continuity. Experimental results on GID and FBPS demonstrate that SFR-Net achieves state-of-the-art performance, improving mIoU by 1.72% and 4.29%, respectively, over the strongest competing methods. In addition, the proposed scale-frustum representations can be integrated into generic segmentation networks to improve both segmentation accuracy and convergence speed. The implementation code will be publicly available at https://github.com/ChuyuZhong/SFR-Net.
