Search papers, labs, and topics across Lattice.
This paper benchmarks eight state-of-the-art Visual Anomaly Detection (VAD) methods on the AnoVox dataset, the largest synthetic dataset for anomaly detection in autonomous driving, to assess their suitability for identifying anomalous objects not seen during training. The evaluation spans four backbone architectures, including large and lightweight networks, to determine the accuracy-efficiency trade-offs for edge deployment. The key finding is that Tiny-Dinomaly achieves the best accuracy-efficiency trade-off, matching full-scale localization performance at a fraction of the memory cost, demonstrating the effective transfer of VAD to road scenes.
Lightweight anomaly detection models can now match the performance of their larger counterparts in autonomous driving scenarios, opening the door for safer edge deployment.
The reliability of a machine vision system for autonomous driving depends heavily on its training data distribution. When a vehicle encounters significantly different conditions, such as atypical obstacles, its perceptual capabilities can degrade substantially. Unlike many domains where errors carry limited consequences, failures in autonomous driving translate directly into physical risk for passengers, pedestrians, and other road users. To address this challenge, we explore Visual Anomaly Detection (VAD) as a solution. VAD enables the identification of anomalous objects not present during training, allowing the system to alert the driver when an unfamiliar situation is detected. Crucially, VAD models produce pixel-level anomaly maps that can guide driver attention to specific regions of concern without requiring any prior assumptions about the nature or form of the hazard. We benchmark eight state-of-the-art VAD methods on AnoVox, the largest synthetic dataset for anomaly detection in autonomous driving. In particular, we evaluate performance across four backbone architectures spanning from large networks to lightweight ones such as MobileNet and DeiT-Tiny. Our results demonstrate that VAD transfers effectively to road scenes. Notably, Tiny-Dinomaly achieves the best accuracy-efficiency trade-off for edge deployment, matching full-scale localization performance at a fraction of the memory cost. This study represents a concrete step toward safer, more responsible deployment of autonomous vehicles, ultimately improving protection for passengers, pedestrians, and all road users.