Search papers, labs, and topics across Lattice.
This paper introduces FSDC-DETR, a novel framework for small object detection that addresses the limitations of existing detectors by explicitly modeling spatial and frequency representations. The approach employs Dual-Branch Frequency-Spatial Adaptive Fusion (DBFSAF) to enhance frequency diversity and uses a frequency-spatial interaction scheme for effective feature propagation. Experimental results show that FSDC-DETR outperforms state-of-the-art methods, achieving significant improvements in average precision for both general and small objects on benchmark datasets.
FSDC-DETR boosts small object detection performance by over 6 AP points, leveraging a unique frequency-spatial collaborative approach that preserves high-frequency details.
Small object detection (SOD) remains a challenging task in real-world applications. Despite recent advances, existing detectors remain limited by rigid processing that entangle spatial aggregation with implicit frequency aliasing and truncation, leading to inadequate preservation of high-frequency components for SOD. To tackle these limitations, we propose a Frequency-Spatial Domain Collaborative Detection Transformer (FSDC-DETR), a novel collaborative framework that explicitly models complementary spatial and frequency representations. Specifically, we first introduce Dual-Branch Frequency-Spatial Adaptive Fusion (DBFSAF) to enhance frequency diversity and adaptively capture frequency-spatial domain discriminative representations. Building on these representations, a frequency-spatial interaction scheme is further explored within the hybrid encoder to enable progressive feature propagation to the decoder. In particular, structure-aware frequency-spatial aggregation is achieved through Shunt Frequency-Spatial Feature Fusion (SFS-FF), establishing bidirectional interaction and progressive cross-scale propagation between frequency and spatial representations for coherent discriminative modeling. Meanwhile, informative high-frequency responses are preserved during scale transitions through Frequency-Spatial Dynamic Downsampling (FSD-Down), thereby minimizing frequency degradation throughout multi-scale fusion for the precise SOD. Experimental results demonstrate that FSDC-DETR achieves state-of-the-art performance, improving AP by 6.4 on VisDrone-DET2019 and 6.6 on AITODv2, with gains of 6.8 and 6.9 AP for small objects. The code is available at github.com/nevereverinsomnia/FSDC-DETR.
