Search papers, labs, and topics across Lattice.
This study tackles the challenge of vehicle color recognition in surveillance systems, particularly under severe class imbalances in color distributions. By employing synthetic minority-class augmentation through advanced generative strategies and combining it with modern visual representations and ensemble methods, the authors achieve a notable improvement in macro accuracy by 8.2 percentage points, reaching 79.7%. The findings underscore the persistent difficulties in color-based identification, even for human annotators, revealing the inherent limitations of this approach in real-world scenarios.
Achieving a macro accuracy of 79.7% in vehicle color recognition highlights the potential of synthetic data augmentation to address severe class imbalances in surveillance contexts.
Vehicle color recognition is an important cue for vehicle identification in surveillance systems, especially when license plates are illegible due to low resolution, occlusion, motion blur, or poor illumination. However, real-world vehicle color distributions are highly imbalanced, making overall accuracy insufficient to assess performance on rare but operationally relevant colors. This paper presents a comprehensive study of vehicle color recognition under severe class imbalance using UFPR-VeSV, a challenging real-world surveillance dataset. We investigate synthetic minority-class augmentation through two off-the-shelf generative strategies: text-conditioned image generation with RunDiffusion/JuggernautXL and image-conditioned color editing with Gemini 2.0 Flash. The curated synthetic data are combined with modern visual representations, loss reweighting, learning-rate scheduling, color-safe augmentation, foreground-aware preprocessing, and ensemble fusion. The bestperforming approach achieves 94.6% micro accuracy and 79.7% macro accuracy, improving macro accuracy by 8.2 percentage points over recent literature. A manual error analysis further shows that many remaining failures are visually ambiguous even for human annotators, highlighting the practical limits of color-based vehicle identification in unconstrained surveillance imagery. The generated images and source code are publicly available at https://github.com/viniciusorru/vcr-synthetic
