Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
AutonomyLens is introduced, an LLM-driven framework unifying scenario specification, simulation execution, and telemetry analysis for autonomous cyber-physical systems validation. It translates high-level validation intent into executable scenarios, automates simulations, and performs context-aware analysis. The framework then uses counterfactual scenario generation to refine test cases from observed failures, closing the loop for improved system validation.
LLMs can now autonomously generate and refine simulation-based test scenarios for autonomous systems, closing the loop between validation intent and observed failures.
Software engineering practices for validating autonomous cyber-physical systems (e.g., Uncrewed Aerial Vehicles) remain fragmented across scenario design, simulation execution, and telemetry analysis, limiting traceability between requirements, tests, and evidence. This fragmentation reduces reproducibility, slows debugging and iteration, and hinders systematic assurance under complex and evolving environmental conditions. We present AutonomyLens, an LLM-driven framework that integrates scenario specification, simulation execution, and telemetry analysis into a unified validation workflow. AutonomyLens enables developers to translate high-level validation intent into executable, temporally evolving scenarios, automatically run simulations, and perform context-aware analysis of resulting system behavior. The framework introduces (i) a structured representation for mission-level scenarios, (ii) an automated execution pipeline, (iii) analysis mechanisms that align telemetry with scenario context to produce actionable insights, and (iv) counterfactual scenario generation that closes the loop by refining and synthesizing new test cases from observed failures. We describe the early-stage design of AutonomyLens, discuss key challenges in building integrated validation workflows for autonomous systems, and outline how such an approach can improve traceability, reproducibility, and scalability in autonomy validation.