Search papers, labs, and topics across Lattice.
This paper introduces SiConMo, a lightweight framework for semantic segmentation that effectively balances accuracy and efficiency by focusing on the bottleneck stage of contextual aggregation. By integrating a Token Pyramid Extraction Module, a Transformer-Branched Depthwise Convolution block, and a Feature Merging Module, SiConMo captures both local and global context without incurring high computational costs. Extensive evaluations on benchmark datasets reveal that SiConMo outperforms existing lightweight models, underscoring the importance of simplicity in design for high-resolution imagery tasks.
Achieving state-of-the-art performance in lightweight semantic segmentation, SiConMo reveals that simplicity in design can outperform complex architectures.
Semantic segmentation demands a careful balance between accuracy, efficiency, and scalability, which remains difficult to achieve for high-resolution imagery. Convolutional networks effectively model local patterns but struggle with long-range dependencies, whereas Vision Transformers capture global context at a high computational cost. While recent work largely focuses on encoder design, the bottleneck stage, central to contextual aggregation and information flow, has been relatively overlooked. We propose SiConMo, a lightweight yet effective framework, implemented in two variants: an RGB-only model (SiConMo) and a GME-enhanced variant (SiConMo$_\dagger$). We show that simplicity arises from a key design principle: at very low computational budgets, the bottleneck is the most efficient stage to integrate local and global context. SiConMo integrates three complementary components: a Token Pyramid Extraction Module for hierarchical multi-scale representation, a Transformer-Branched Depthwise Convolution block for bottleneck-aware context modeling, and a Feature Merging Module that preserves spatial structure while enhancing semantic consistency. Extensive experiments on ADE20K, PASCAL Context, Cityscapes, and COCO-Stuff demonstrate that SiConMo achieves a state-of-the-art accuracy-efficiency trade-off among lightweight semantic segmentation models, highlighting simplicity as a powerful design principle.
