Search papers, labs, and topics across Lattice.
This study investigates the integration of explainability requirements within Requirements Engineering (RE) practices at Daimler Truck, revealing significant challenges across the RE lifecycle. Through a multi-phase qualitative analysis involving eight practitioners, the research identifies issues such as conceptual ambiguity in elicitation, limited expressiveness in specification, and fragmented validation processes. The findings underscore the inadequacy of current RE practices in systematically addressing explainability, paving the way for an empirically grounded framework to enhance AI explainability in safety-critical domains.
Current RE practices fall short in supporting explainability, revealing critical gaps that could jeopardize safety in AI systems.
Explainability has emerged as a critical requirement for AI-based systems, particularly in safety-critical and regulated domains. Although prior research has proposed frameworks, patterns, and user-centered approaches to support explainability, there is limited empirical understanding of how existing Requirements Engineering (RE) practices support explainability requirements across the RE lifecycle, especially in an industrial context. This paper reports early findings from an ongoing industry-based study investigating how explainability requirements are elicited, specified, and validated using established RE techniques. We conducted a multi-phase qualitative study with eight practitioners at Daimler Truck, employing think-aloud protocols and moderated group discussions across requirements elicitation, specification, and validation steps. Our preliminary analysis reveals recurring challenges across all steps, including conceptual ambiguity during elicitation, limited testability and expressiveness during specification, and fragmented validation due to vague criteria and regulatory uncertainty. These findings indicate that current RE practices provide limited support to systematically address explainability requirements. The paper contributes empirical insights into step-specific and cross-cutting challenges and outlines a research vision toward developing an empirically grounded RE framework for explainable AI-based systems.
