Search papers, labs, and topics across Lattice.
This paper addresses the challenge of unsupervised public transport vehicle categorization from urban surveillance video by fusing deep morphological features from a frozen DINOv2 ViT with handcrafted HSV color histograms. The weighted early fusion approach, followed by UMAP and K-Means, successfully clusters vehicles based on route and type, demonstrating that color information significantly enhances route-level discrimination when balanced against robust morphological representations. The method achieved 14 distinct clusters, improving precision for target route identification compared to morphology alone.
Unsupervised clustering of public transport vehicles reveals distinct routes and types by fusing deep morphological features with color histograms, outperforming morphology-only approaches.
Surveillance cameras along urban roads produce large volumes of unlabeled video that could support the monitoring of public transport, but grouping the observed vehicles into meaningful categories without manual annotation remains challenging, since buses from different routes often share the same body structure and differ mainly in their color schemes. This study presents an unsupervised clustering methodology for public transport vehicles that combines morphological features extracted with a frozen DINOv2 Vision Transformer and handcrafted HSV color histograms through weighted early fusion, followed by UMAP projection and K-Means clustering. The method was evaluated on 7,972 bus images extracted from about 1,460 hours of video of an arterial road in Mexico City, with the goal of isolating the buses of the city's public bus network (RTP) without supervision. With a fusion of 65\% morphological and 35\% color features, the pipeline produced 14 clusters that separate distinct routes and vehicle types, and it increased the precision of the target cluster with respect to morphological features alone. These results show that color complements self-supervised features for route-level clustering, provided that it does not dominate the representation.