Search papers, labs, and topics across Lattice.
This paper examines the challenges in ensuring the dependability (safety, security, reliability) of autonomous systems that integrate AI/ML components, focusing on the limitations of traditional methods in addressing the dynamic and uncertain behaviors introduced by AI. It highlights the need for holistic approaches spanning multiple abstraction layers and encompassing both design- and run-time assurance. The paper explores emerging methodologies, architectures, and frameworks for designing dependable autonomous and embedded systems, specifically addressing reliability modeling, secure system design, and certification approaches for learning-enabled components.
AI's non-determinism and data-dependence create critical gaps in the verification, validation, and certification of safety-critical autonomous systems.
The design of embedded safety-critical systems such as those used in next-generation automotive and autonomous platforms, is increasingly challenged by escalating system complexity, hardware-software heterogeneity, and the integration of intelligent, data-driven components. Ensuring dependability in such systems requires a holistic approach that spans multiple abstraction layers and encompasses both design- and run-time assurance. Traditional methods for reliability, safety, and security management often fall short in addressing the dynamic and uncertain behaviors introduced by Artificial Intelligence (AI) and Machine Learning (ML) components, especially under stringent real-time, power, and safety constraints. While AI and ML offer powerful predictive, adaptive, and self-optimizing capabilities that can enhance system dependability, their inherent non-determinism, data-dependence, and lack of formal guarantees introduce new challenges for verification, validation, and certification. This paper explores emerging methodologies, architectures, and frameworks for designing dependable autonomous and embedded systems in the era of AI. It highlight advances in reliability modeling, secure system design, and certification approaches that account for imperfect, learning-enabled components, aiming to bridge the gap between AI innovation and certifiable system-level dependability.
