Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces an instance-aware knowledge distillation framework for semi-supervised learning aimed at enhancing collision avoidance systems in resource-constrained environments. By generating pseudo labels that integrate domain knowledge and instance-centric insights from foundation models, the lightweight student model significantly outperforms the larger teacher model in instance segmentation while maintaining performance in monocular depth estimation. The resulting system achieves a remarkable reduction in computational requirements, with a 22.68× decrease in FLOPs and a 14.33× reduction in parameters, enabling real-time operation on low-cost edge devices.
A lightweight model can outperform larger counterparts in collision avoidance tasks while slashing computational costs, making real-time deployment feasible in resource-limited environments.
Collision avoidance systems have evolved toward camera-based deep learning approaches for driving scene understanding. However, deployment in edge environments such as country clubs is constrained by limited computational resources and unreliable communication infrastructure. Moreover, constructing large-scale datasets for the target domain involves substantial annotation cost. To address these limitations, we propose an instance-aware knowledge distillation framework for semi-supervised learning. Specifically, we generate pseudo labels that mitigate teacher bias by leveraging domain priors from the teacher and instance-centric knowledge from foundation models. The trained lightweight student is deployed in the proposed collision avoidance system and performs multiple dense prediction tasks in real-time. The system detects frontal obstacles and encodes their spatial information into controller area network messages for automated guided vehicle operation. To achieve this, we construct a large-scale country club dataset and perform field validation of the proposed system. Experimental results demonstrate that the student outperforms the large teacher in instance segmentation while mitigating performance degradation in monocular depth estimation. Compared with the teacher, the student reduces FLOPs by 22.68$\times$ and parameters by 14.33$\times$, achieving 6.46 FPS on a low-cost edge device.