Search papers, labs, and topics across Lattice.
Reload-Mamba introduces a novel framework for multi-class semantic segmentation that mitigates response dilution in state-space models through three innovative designs: a boundary-supervised local detail prior, a class-uncertainty-aware Reload Gate, and a hierarchical multi-level Reload mechanism. These enhancements enable the model to effectively restore critical boundary and detail-sensitive responses, achieving significant improvements in segmentation accuracy. The framework demonstrates state-of-the-art performance with 47.9% mIoU on ADE20K and 87.8% mIoU on PASCAL VOC 2012, showcasing the effectiveness of its segmentation-specific adaptations.
Reload-Mamba achieves a remarkable 2.2 mIoU improvement over previous models by specifically addressing response dilution in multi-class semantic segmentation.
Mamba-based state space models offer linear-time long-range modeling for high-resolution dense prediction, but sequential state-space propagation can attenuate boundary-sensitive and detail-sensitive responses that are critical in multi-class semantic segmentation. We propose Reload-Mamba, a semantic segmentation framework that addresses this propagation-induced response dilution through three segmentation-specific designs: (i) a boundary-supervised local detail prior that is explicitly trained with ground-truth boundary masks to identify regions requiring response restoration; (ii) a class-uncertainty-aware Reload Gate that incorporates per-pixel class entropy from a pre-reload auxiliary head as an additional gating signal, a formulation that is informative only under multi-class dense prediction; and (iii) a hierarchical multi-level Reload mechanism that applies anti-dilution refinement at three decoder levels and fuses the restored representations top-down. Built upon a ConvNeXt-Tiny encoder with a multi-scale decoder and four-directional Mamba scanning with pixel-wise directional attention, Reload-Mamba achieves 47.9% single-scale (48.9% multi-scale) mIoU on ADE20K and 83.2% single-scale mIoU on Cityscapes. With ResNet-101 + COCO pre-training under the standard DeepLab-style protocol, Reload-Mamba reaches 87.8% mIoU on PASCAL VOC 2012 val. Controlled ablations show that each of the three segmentation-specific designs contributes beyond a direct port of the prior anti-dilution architecture proposed for binarization, cumulatively improving over the direct-port baseline by +2.2 mIoU on ADE20K.
