Search papers, labs, and topics across Lattice.
This paper introduces MDDCNet, a novel traffic object detection network that combines Mamba state-space models with deformable dilated convolutions to address the challenges of detecting varying-scale objects in cluttered traffic scenes. The core innovation lies in a hybrid backbone featuring Multi-Scale Deformable Dilated Convolution (MSDDC) blocks and Mamba blocks for hierarchical feature representation, coupled with a Channel-Enhanced Feed-Forward Network (CE-FFN) and a Mamba-based Attention-Aggregating Feature Pyramid Network (A^2FPN) for enhanced multi-scale feature fusion. Experiments on public benchmarks and real-world datasets demonstrate that MDDCNet outperforms existing state-of-the-art object detectors.
Mamba's long-range prowess gets a local detail boost: deformable dilated convolutions let state-space models finally see the small stuff in cluttered scenes.
In a real-world traffic scenario, varying-scale objects are usually distributed in a cluttered background, which poses great challenges to accurate detection. Although current Mamba-based methods can efficiently model long-range dependencies, they still struggle to capture small objects with abundant local details, which hinders joint modeling of local structures and global semantics. Moreover, state-space models exhibit limited hierarchical feature representation and weak cross-scale interaction due to flat sequential modeling and insufficient spatial inductive biases, leading to sub-optimal performance in complex scenes. To address these issues, we propose a Mamba with Deformable Dilated Convolutions Network (MDDCNet) for accurate traffic object detection in this study. In MDDCNet, a well-designed hybrid backbone with successive Multi-Scale Deformable Dilated Convolution (MSDDC) blocks and Mamba blocks enables hierarchical feature representation from local details to global semantics. Meanwhile, a Channel-Enhanced Feed-Forward Network (CE-FFN) is further devised to overcome the limited channel interaction capability of conventional feed-forward networks, whilst a Mamba-based Attention-Aggregating Feature Pyramid Network (A^2FPN) is constructed to achieve enhanced multi-scale feature fusion and interaction. Extensive experimental results on public benchmark and real-world datasets demonstrate the superiority of our method over various advanced detectors. The code is available at https://github.com/Bettermea/MDDCNet.