Search papers, labs, and topics across Lattice.
The paper introduces STRIVE-D, a data-calibrated retrieval framework designed to enhance video retrieval for complex queries in autonomous driving by addressing the limitations of existing vision-language and keyword-based methods. By leveraging weakly labeled in-domain videos, STRIVE-D intelligently assesses the reliability of query rules and adapts them based on real driving data, effectively merging rule-based and traditional retrieval signals. The framework achieves up to an 84% relative improvement in top-1 accuracy across three driving benchmarks, demonstrating significant advancements in retrieving dynamic driving events like cut-ins and hard braking.
STRIVE-D achieves up to 84% relative improvement in video retrieval accuracy by intelligently adapting query rules to real-world driving data.
Video retrieval at scale is central to data curation and safety validation in autonomous driving, where users want to find not only scenes but also dynamic events such as cut-ins and hard braking. Existing vision-language and keyword-based retrieval methods often miss these events because the relevant motion may not be explicitly described in text or captured by lexical overlap. Rule-based retrieval can encode such events more directly, but it is brittle: generated or hand-written rules often fail when their assumptions do not match real driving data. We propose STRIVE-D, a data-calibrated retrieval framework for driving videos. It uses weakly labeled in-domain videos to estimate when a query rule is reliable, adapt rules that mismatch observed data, and fuse calibrated rule scores with vision-language and keyword-based retrieval signals. Across three driving benchmarks, including newly released human-annotated event data on DrivingDojo, STRIVE-D delivers up to 84% relative improvement in top-1 accuracy over state-of-the-art methods.
