Search papers, labs, and topics across Lattice.
This paper introduces GMBFormer, a SegFormer-based framework designed for urban green-space extraction from ultra-high-resolution imagery by utilizing a global memory bank approach. By decoupling the Normalized Difference Vegetation Index (NDVI) from RGB inputs and employing selective prototype retrieval, the model enhances semantic reuse and improves performance over traditional patch-based methods. Experimental results on a self-constructed dataset demonstrate significant improvements in mean intersection over union (mIoU) and mean Dice (mDice) scores compared to the baseline, highlighting the effectiveness of the proposed memory-mediated cross-attention mechanism.
GMBFormer achieves state-of-the-art urban green-space extraction by leveraging a global memory bank that enhances semantic reuse without compromising on visual fidelity.
Urban green-space extraction from ultra-high-resolution (UHR) imagery is commonly performed patch by patch, which limits semantic reuse among spatially separated but visually similar vegetation patterns. Directly injecting the Normalized Difference Vegetation Index (NDVI) into red-green-blue (RGB) backbones can also blur the roles of visual appearance learning and physical vegetation confidence. We propose GMBFormer, a SegFormer-based framework that replaces adjacency-driven feature propagation with selective, similarity-driven prototype retrieval. Only RGB channels enter the backbone and decoder, while NDVI is decoupled as a physics-informed gate that admits high-confidence vegetation descriptors into a compact global memory bank through momentum updates. During training and inference, the current patch queries stored prototypes through memory-mediated cross-attention, and the retrieved response is integrated with bounded overhead. Experiments use a self-constructed Chengdu UHR dataset with 7,700 labeled 512 x 512 patches and two reduced-label settings derived from the public International Society for Photogrammetry and Remote Sensing (ISPRS) Potsdam dataset. Under the same training and evaluation protocol, GMBFormer obtains mean intersection over union (mIoU)/mean Dice (mDice) scores of 89.25%/94.31%, 92.17%/95.92%, and 83.72%/90.86%, respectively, improving the controlled SegFormer-B4 baseline in each setting. Ablation studies indicate that decoupled NDVI admission, memory retrieval, capacity, and momentum jointly shape the final performance.
Tsinghua AI