Search papers, labs, and topics across Lattice.
This paper introduces NSF-HRPT, a framework that integrates a Neural Semantic Field (NSF) with a Hierarchical Risk Perception Tree (HRPT) to enhance risk assessment in safety-critical scenarios for autonomous driving. By leveraging simulation data to model scene semantics and probabilistic Time-to-Collision (TTC) distributions, the framework allows for efficient parallel computation and spatial reasoning about multi-agent risks. Extensive evaluations show that NSF-HRPT achieves state-of-the-art performance on synthetic benchmarks and competitive results on real-world datasets, significantly improving real-time risk awareness from monocular vision inputs.
Real-time risk assessment in autonomous driving just got a major upgrade, achieving state-of-the-art performance with a novel framework that combines perception and structured reasoning.
The ability to accurately assess and anticipate risks in safety-critical scenarios is crucial for autonomous driving systems. While existing research has made progress in collision prediction, accurately quantifying risk levels from monocular vision inputs remains challenging due to the complex dynamics of multi-agent interactions and the inherent uncertainty in real-world environments. To address these challenges, we present NSF-HRPT, a novel framework that combines learning-based perception with structured reasoning for quantitative risk assessment. Our approach features a Neural Semantic Field (NSF) that learns to model scene semantics, trajectory predictions, and probabilistic Time-to-Collision (TTC) distributions from simulation data. During inference, the pre-trained NSF serves as a prior for our Hierarchical Risk Perception Tree (HRPT), which enables efficient parallel computation and spatial reasoning about multi-agent risks. Additionally, we introduce a Sim2Real enhancement strategy that improves real-world applicability without retraining by incorporating priors from foundation models. Extensive evaluations demonstrate that our framework achieves state-of-the-art performance on synthetic benchmarks and delivers competitive, near-state-of-the-art results on real-world datasets for both TTC estimation accuracy and risk localization precision. The proposed method provides an effective solution for real-time risk awareness from monocular camera inputs.
