Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the use of Vision-Language Models (VLMs) for zero-shot semantic re-identification (ReID) in autonomous driving, moving beyond traditional visual matching methods that struggle with environmental variations. By generating textual descriptions of traffic participants based on structured semantic attributes, the approach achieves retrieval performance comparable to supervised CNN baselines while enhancing interpretability. However, the findings highlight significant challenges, such as attribute inconsistency and difficulties in distinguishing visually similar instances, underscoring the need for further refinement in VLM applications for ReID tasks.
Zero-shot semantic descriptions can match the performance of traditional supervised models in object re-identification, while providing clearer interpretability.
Re-Identification (ReID) in autonomous driving is typically formulated as a visual matching problem, where observations of vehicles, pedestrians, and cyclists are associated across time, frames, or camera views using learned appearance embeddings, often complemented by motion, geometric, or multimodal cues. However, purely visual representations may be sensitive to viewpoint, occlusion, illumination, and sensor-domain variations, limiting their interpretability and robustness in complex driving scenes. We propose a baseline study of a zero-shot pipeline using Vision-Language Models (VLMs) to generate textual descriptions of detected traffic participants and evaluate whether these descriptions can support identity matching across observations. Instead of relying only on low-level visual similarity, the proposed formulation represents each object through structured semantic attributes, including category, color, shape, pose, visible parts, spatial context, and distinctive visual cues. This study provides an initial benchmark for language-based re-identification in autonomous-driving scenarios, discussing and evaluating the strengths and limitations of current VLMs for this task. Results demonstrate that zero-shot semantic descriptions can support effective object re-identification, achieving retrieval performance comparable to a supervised CNN baseline while offering greater interpretability through explicit identity cues. However, the experiments also reveal important challenges, including attribute inconsistency across viewpoints and limited fine-grained discrimination between visually similar instances.