Search papers, labs, and topics across Lattice.
This paper introduces InterPruner, an innovative interactive structured pruning framework tailored for RGB-infrared object detection, addressing the challenges of channel redundancy and computational inefficiency in multimodal systems. By leveraging a Taylor-Implicit Criterion to assess channel importance and employing a Modality Interaction Redundancy Analyzer alongside a Scene-Prior Channel Anchor, the authors effectively quantify and prune redundant channels while preserving detection performance. The results demonstrate that InterPruner can prune 50% of channels with a 0.6% increase in mean Average Precision (mAP) on the FLIR dataset, highlighting its efficacy in enhancing multimodal detection systems.
Pruning 50% of channels in RGB-infrared object detectors can actually boost performance by 0.6% mAP, challenging conventional wisdom about redundancy.
Multimodal object detection proves effective in remote sensing, especially the RGB-Infrared paradigm. The parallel feature extractors provide rich multimodal information for robust detection, yet introduce substantial channel redundancy and computational overhead. Existing pruning methods can reduce channel redundancy, but they are designed for unimodal backbones, overlooking cross-modal interactions and dynamic scene-wise redundancy. In this paper, we propose InterPruner, the first interactive structured channel pruning framework for RGB-infrared object detectors. Specifically, we first derive a Taylor-Implicit Criterion(TIC) to quantify channel importance via high-order Taylor expansion and the implicit function theorem. Then, a Modality Interaction Redundancy Analyzer (MIRA) identifies redundant channels via mutual compensability assessment. Finally, a Scene-Prior Channel Anchor (SPCA) uses language priors as semantic anchors to measure channel-scene relevance for dynamic channel importance estimation. Cross-modality channel pruning for RGB-Infrared detection is yet unexplored. Extensive experiments on RGB-infrared object detection dataset demonstrate that InterPruner maintains high performance with negligible degradation. Specifically, it even achieves a 0.6% mAP increase on the FLIR dataset when pruning 50% of the channels. Code will be available on GitHub to facilitate future work.