Search papers, labs, and topics across Lattice.
This paper introduces RT-SFOD, a novel approach to source-free object detection that leverages a dual-head architecture based on YOLOv10 to achieve superior adaptation accuracy while maintaining lower latency and memory usage. The authors address the limitations of traditional mean-teacher self-training by proposing a Dual-Head Pseudo-Label Fusion (DHF) strategy and a Multi-scale Adaptive Representation Diversification (MARD) loss, which enhance the model's ability to adapt under domain shifts. As a result, RT-SFOD demonstrates significant improvements in mean Average Precision (mAP) and throughput, while reducing the model size compared to existing methods.
Achieving up to 3.5% mAP gains and 1.3x higher throughput, RT-SFOD redefines the trade-offs in source-free object detection by being faster and more compact without sacrificing accuracy.
Real-world detectors for autonomous driving, surveillance, and robotics must handle domain-shifts under strict latency and memory constraints, yet existing source-free object detection (SFOD) methods rely on heavyweight architectures that prioritize accuracy alone. We show this trade-off is unnecessary: building on YOLOv10, an NMS-free dual-head detector, we achieve state-of-the-art adaptation accuracy while being faster and more compact. We observe that directly applying vanilla mean-teacher self-training to dual-head detectors leads to suboptimal adaptation performance due to two key factors. First, simple pseudo-label generation strategies, such as using a single head or directly combining high-confidence predictions from both heads, yield suboptimal supervision under domain-shift. We propose DHF (Dual-Head Pseudo-Label Fusion) which selectively admits one-to-one (O2O) and one-to-many (O2M) head predictions, preserving precision and recovering missed objects. Second, we observe domain-shift collapses multi-scale feature discriminability. We propose the use of our MARD (Multi-scale Adaptive Representation Diversification) loss which mitigates this by enforcing detection-aware variance and covariance constraints on multi-scale feature maps. Both modules are training-time only, leaving inference unchanged. Across domain-shift benchmarks, our method, RT-SFOD yields 1.4 to 3.5\% mAP gains, 1.3$\times$ higher throughput, with $\sim$2$\times$ fewer parameters than prior state-of-the-art SFOD methods, thus advancing the Pareto frontier of the speed-accuracy-model size trade-off. We report main results with YOLOv10, and demonstrate generalizability with additional YOLO- and DETR-based dual-head detectors. Code is available here: https://github.com/Sairam13001/RT-SFOD/
Microsoft Research