Search papers, labs, and topics across Lattice.
This paper introduces RISC (Risk-Informed Slice Coverage), a protocol designed to enhance safety in autonomous driving by focusing on risk-relevant sub-datasets for stress testing. By leveraging risk-guided selection, the method significantly boosts the discovery of critical failures from 34.0% to 98.5% compared to random sampling. The model-agnostic approach allows RISC to be applied across various autonomous driving subsystems, ensuring a more thorough evaluation of high-risk driving conditions.
Risk-guided stress testing can elevate critical failure discovery rates from 34% to 98.5%, transforming safety evaluations in autonomous driving.
Aggregate metrics may not fully reflect performance in insufficiently examined high-risk driving conditions. We propose RISC (Risk-Informed Slice Coverage), a practical protocol for risk-guided stress testing and coverage-qualified evaluation. Risk-guided stress testing directs a finite audit budget toward risk-relevant sub-datasets, called risk slices, while coverage-qualified evaluation reports results together with explicit statements about which slices are sufficiently or insufficiently covered. The protocol translates safety concerns into machine-readable risk slices, uses lightweight signals to tag candidate data, selects a compact audit set by risk, and qualifies the results using coverage evidence. An LLM can optionally support this process by surfacing relevant but potentially overlooked conditions during test planning, thereby helping engineers not to forget the obvious. RISC is model-agnostic and can be applied to perception modules, driving models, and other autonomous-driving subsystems. We instantiate the protocol for monocular pedestrian perception using 1,000 frames from the Zenseact Open Dataset, image statistics, and a YOLO-based detector proxy. In this proof-of-concept study, risk-guided selection increases critical failure discovery from 34.0% under random sampling to 98.5%. RISC provides a lightweight, assurance-oriented evaluation layer that complements scenario categorization, coverage assessment, and broader testing-and-verification workflows.
