Search papers, labs, and topics across Lattice.
MambaCount introduces a novel framework for Text-guided Open-vocabulary Object Counting (TOOC) that overcomes the limitations of existing Transformer-based approaches by utilizing a Spatial Sparse State Space Duality (S^4D) block. This method addresses the challenges of bidirectional spatial dependency modeling and high entropy in spatial token responses by reconstructing decay dynamics and implementing a Spatial Token Selection (STS) sub-block. Extensive evaluations on the FSC-147 dataset reveal that MambaCount achieves state-of-the-art performance with a mean absolute error (MAE) of 12.23 while maintaining linear computational complexity, marking a significant advancement in scalable object counting in dense scenes.
MambaCount achieves state-of-the-art object counting accuracy with linear complexity, challenging the dominance of Transformer-based methods in dense visual environments.
Text-guided Open-vocabulary Object Counting (TOOC) aims to estimate the number of objects described by text prompts, which is particularly challenging in dense scenes with large scale variations. Existing TOOC approaches predominantly rely on Transformers, whose quadratic complexity with respect to image resolution limits their scalability. Mamba offers a promising alternative due to its linear complexity. However, previous Mamba-based methods have two main limitations. On the one hand, the inherent causal formulation of Mamba constrains the bidirectional spatial dependency modeling required by non-causal vision tasks. On the other hand, existing Mamba-based vision models often overlook the unconstrained high entropy in the spatial token responses, which can weaken local details and high-frequency cues. To address these limitations, we propose MambaCount, an efficient framework built on the Spatial Sparse State Space Duality (S^4D) block. Specifically, we analyze and reconstruct the decay dynamics of hidden states in Mamba to alleviate the dependency constraints introduced by causal modeling. Moreover, we introduce a Spatial Token Selection (STS) sub-block to reduce the unconstrained high entropy in spatial token responses within Mamba. In addition, we design Multi-Granularity Prototypes (MGP) to identify object-like regions at different semantic levels, improving cross-modal alignment and interpretability. Extensive experiments on FSC-147 demonstrate that MambaCount achieves state-of-the-art performance among methods without secondary querying, obtaining a test MAE of 12.23, while retaining linear complexity.
