Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a self-supervised relevance model for autonomous driving that utilizes counterfactual analysis to determine the significance of objects in the vehicle's environment. By focusing computational resources on relevant objects, the approach enhances efficiency, reduces processing latency, and mitigates perception noise. The model demonstrates real-time relevance estimation with millisecond-level latency in high-density scenarios, providing insights through relevance heatmaps that can inform driving policy and planning tasks.
Real-time relevance estimation in autonomous vehicles can drastically reduce computational load and improve decision-making efficiency by focusing only on key environmental objects.
Autonomous driving relies on computationally intensive perception pipelines to continuously detect and track objects in the surrounding environment. While some objects are key to plan safe and effective maneuvers, others may not be relevant and have no impact on the autonomous vehicle's driving decisions. Focusing on relevant objects allows a more efficient usage of available computational resources, reduces processing latencies, and limits the downstream propagation of perception noise. In this work, we propose a novel self-supervised approach based on counterfactual analysis to develop a relevance model - an AI-based tool that quantifies the relevance of objects for an autonomous vehicle. To demonstrate the potential of the proposed approach, we train a relevance model on a synthetic causal dataset generated in a selected urban scenario. Results show that the relevance model is able to accurately estimate the objects' relevance with millisecond-level latency, enabling real-time relevance estimation also in high-density scenarios. We also show that the relevance model can be used to build relevance heatmaps that offer valuable insights into the autonomous vehicle's driving policy and can be used to proactively inform perception and planning tasks. We openly release both the relevance model and the causal dataset.