Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces M^2C-EvDet, a novel framework for enhancing event-based object detection (EvDet) by employing multi-domain and multi-order cross-modal knowledge distillation. By integrating Adaptive Frequency-Decoupled Feature Distillation (AF^2D^2) and Multi-Order Relational Distillation (MORD), the framework effectively bridges the performance gap between EvDet and traditional frame-based detection methods, addressing the limitations of previous approaches that focused solely on spatial semantics. The results demonstrate significant improvements in detection accuracy across various complex scenarios, showcasing the framework's potential to leverage the strengths of both event and frame-based data.
Bridging the performance gap between event-based and frame-based object detection, M^2C-EvDet leverages multi-domain knowledge distillation to enhance accuracy in complex environments.
Event-based object Detection (EvDet), as a biologically inspired visual perception paradigm, demonstrates superior performance in scenarios demanding high temporal resolution and a wide dynamic range. Nevertheless, the inherent sparse representations and inadequate visual semantics of event data result in a considerable performance disparity between EvDet and frame-based object detection. Previous works attempt to alleviate this cross-modal discrepancy through knowledge distillation, yet they only focus on spatial visual semantics or pair-wise relational information, thus limiting performance in more complex scenarios. To address this challenge, this paper proposes M^2C-EvDet, a Multi-domain and Multi-order Cross-modal knowledge distillation framework for EvDet. Built upon frequency learning and hypergraph computation, M^2C-EvDet integrates two specialized modules: Adaptive Frequency-Decoupled Feature Distillation (AF^2D^2) and Multi-Order Relational Distillation (MORD).