Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores the application of model-level Mixture-of-Experts (MoE) architectures to object detection, addressing the challenges of merging dense predictions from specialized detectors. By combining YOLO-based models trained on semantically distinct data subsets with a learned gating network, the authors enhance both performance and interpretability in object detection tasks. Experiments on the BDD100K dataset reveal that the proposed MoE architecture outperforms traditional ensemble methods while providing valuable insights into expert specialization across different domains.
Model-level mixtures of experts can significantly boost object detection performance while enhancing interpretability, outperforming conventional ensemble methods.
Mixture-of-Experts (MoE) models provide a structured approach to combining specialized neural networks and offer greater interpretability than conventional ensembles. While MoEs have been successfully applied to image classification and semantic segmentation, their use in object detection remains limited due to challenges in merging dense and structured predictions. In this work, we investigate model-level mixtures of object detectors and analyze their suitability for improving performance and interpretability in object detection. We propose an MoE architecture that combines YOLO-based detectors trained on semantically disjoint data subsets, with a learned gating network that dynamically weights expert contributions. We study different strategies for fusing detection outputs and for training the gating mechanism, including balancing losses to prevent expert collapse. Experiments on the BDD100K dataset demonstrate that the proposed MoE consistently outperforms standard ensemble approaches and provides insights into expert specialization across domains, highlighting model-level MoEs as a viable alternative to traditional ensembling for object detection. Our code is available at https://github.com/KASTEL-MobilityLab/mixtures-of-experts/.