Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel method for extracting driving scenarios from unlabelled egocentric datasets by leveraging scene graphs and Linear Temporal Logic (LTL). The approach enables automated identification of critical scenarios within large sensor data streams, facilitating comprehensive scenario-based coverage analysis for automated driving systems. Evaluated on Argoverse 2 datasets, the method outperforms a rule-based benchmark, showcasing its effectiveness in both simulated and real-world contexts.
Extracting driving scenarios from unlabelled data can now be automated, significantly enhancing scenario-based analysis for automated driving systems.
Extracting scenarios from unlabelled real-world sensor data streams is a critical but challenging task in the development process of automated driving systems (ADS). Automatically sifting through large datasets to spatially and temporally locate critical scenarios can enable scenario-based coverage analysis of ADS datasets. In this paper, we present a method for extracting scenarios from egocentric datasets using scene graphs and Linear Temporal Logic (LTL). We first process egocentric sensor data and HD maps to generate a sequence of scene graphs representing a driving scenario. Next, we use LTL to formally specify driving scenarios of interest, then extract all instances of the scenarios from the dataset using an off-the-shelf model checker, which evaluates the LTL formula against the sequence of scene graphs. Our approach can be used on both simulated and real world datasets. We evaluate the method on the training and validation datasets from Argoverse 2 consisting of 850 15-second real-world driving logs, and several videos of dashcam footage. We demonstrate the effectiveness of our approach for extracting and querying scenarios by evaluating against a rule-based benchmark based on track annotations and HD maps.