Search papers, labs, and topics across Lattice.
This paper integrates unsupervised dictionary learning as a post hoc interpretability module in end-to-end autonomous driving models to break down driving behavior into semantically meaningful concepts. By establishing a framework that connects these concepts to the model's outputs, the authors reveal the decision-making logic behind trajectory predictions and enable targeted interventions to correct erroneous driving decisions. The approach not only enhances interpretability but also leads to measurable improvements in driving performance, addressing the challenges of model opacity in autonomous systems.
Uncovering the causal influence of driving behavior concepts can significantly enhance the safety and performance of autonomous vehicles.
The increasing adoption of end-to-end learning for autonomous driving introduces increased model complexity and opacity, raising the risk of learning undesired or erroneous behavior. In this work, we integrate unsupervised dictionary learning as a post hoc interpretability module within state-of-the-art driving models to decompose driving behavior into semantically meaningful concepts while demonstrating their causal influence on the model's driving decisions. We propose a stepwise framework for extracting and interpreting meaningful concepts from the end-to-end model and connecting them to the multifaceted model outputs, thereby revealing the underlying decision-making logic for the prediction of future trajectories. Furthermore, targeted interventions at the concept level allow us to manipulate and correct driving decisions, resulting in measurable improvements in overall driving performance. We thus demonstrate how interpretability can effectively be used to reduce model opacity, uncover erroneous behavior, and enable targeted mitigation, ultimately boosting model performance.
