Search papers, labs, and topics across Lattice.
The paper introduces CARE Drive, a model-agnostic framework for evaluating the reason-responsiveness of vision-language models (VLMs) in automated driving. It addresses the gap in current evaluation methods that focus on outcome-based performance by assessing whether model decisions reflect human-relevant considerations. The framework uses prompt calibration and systematic contextual perturbation to measure decision sensitivity to human reasons, demonstrating its effectiveness in a cyclist overtaking scenario and revealing varying responsiveness across different contextual factors.
Uncover whether your automated driving model's explanations are genuine reasons or just post-hoc rationalizations with CARE Drive, a new framework revealing how sensitive VLMs are to human-relevant contextual factors.
Foundation models, including vision language models, are increasingly used in automated driving to interpret scenes, recommend actions, and generate natural language explanations. However, existing evaluation methods primarily assess outcome based performance, such as safety and trajectory accuracy, without determining whether model decisions reflect human relevant considerations. As a result, it remains unclear whether explanations produced by such models correspond to genuine reason responsive decision making or merely post hoc rationalizations. This limitation is especially significant in safety critical domains because it can create false confidence. To address this gap, we propose CARE Drive, Context Aware Reasons Evaluation for Driving, a model agnostic framework for evaluating reason responsiveness in vision language models applied to automated driving. CARE Drive compares baseline and reason augmented model decisions under controlled contextual variation to assess whether human reasons causally influence decision behavior. The framework employs a two stage evaluation process. Prompt calibration ensures stable outputs. Systematic contextual perturbation then measures decision sensitivity to human reasons such as safety margins, social pressure, and efficiency constraints. We demonstrate CARE Drive in a cyclist overtaking scenario involving competing normative considerations. Results show that explicit human reasons significantly influence model decisions, improving alignment with expert recommended behavior. However, responsiveness varies across contextual factors, indicating uneven sensitivity to different types of reasons. These findings provide empirical evidence that reason responsiveness in foundation models can be systematically evaluated without modifying model parameters.
