Search papers, labs, and topics across Lattice.
This paper introduces the Unconstrained Vehicle Identification Benchmark (UVIB), designed to evaluate vehicle attribute classification in real-world surveillance scenarios, addressing the degradation of models trained under controlled conditions. By analyzing 84,835 vehicle images across different domains, the study reveals that domain shifts significantly impact model performance, particularly in tasks related to Vehicle Make and Model Recognition (VMMR) and color clarity. The findings emphasize the necessity for benchmarks that assess operational robustness rather than relying solely on in-domain accuracy metrics.
Domain shifts can degrade vehicle attribute classification performance more than the choice of model architecture, revealing critical vulnerabilities in real-world applications.
Vehicle attribute analysis is a key component of Intelligent Transportation Systems (ITS), supporting applications such as vehicle identification, traffic monitoring, and forensic investigation. However, models trained under controlled conditions often degrade in real surveillance scenarios due to changes in viewpoint, occlusion, illumination, and sensor characteristics. This paper introduces Unconstrained Vehicle Identification Benchmark (UVIB), a benchmark for evaluating three operational vehicle-analysis tasks: front/rear orientation, occlusion-related suitability for Vehicle Make and Model Recognition (VMMR), and color clarity. The benchmark contains 84,835 vehicle images from seven public Brazilian datasets, grouped into surveillance and general acquisition domains, with unified binary annotations that were not jointly available in the original sources. Four representative architectures, EfficientNetV2-S, ResNet-50, ViT/B-16, and YOLO11s-cls, are evaluated under mixed-domain, cross-domain, and cross-dataset protocols. The results show that domain shift has a stronger impact than architecture choice, with substantial degradation in cross-domain settings, especially for VMMR suitability and color clarity. While orientation generalizes more reliably, VMMR suitability remains affected by class imbalance and ambiguous occlusions, and color clarity is highly sensitive to illumination and sensor modality. These findings highlight the need for benchmarks and evaluation protocols that explicitly measure operational robustness beyond standard in-domain accuracy. The proposed benchmark is publicly available at https://github.com/UFPR-IPASP-PR/uvib-vehicle-attributes/.
