Search papers, labs, and topics across Lattice.
This paper introduces Req2Road, a GenAI pipeline leveraging LLMs and VLMs to automate the generation of executable test scripts for Software-Defined Vehicles (SDVs) from natural language requirements and specifications. The pipeline extracts signals and behavioral logic, generates Gherkin scenarios, maps them to Vehicle Signal Specification (VSS) signals using retrieval-augmented generation, and converts them into runnable tests. Evaluation on a Child Presence Detection System (CPDS) shows that 89% of requirements can be transformed into executable scenarios, demonstrating the feasibility of the approach in both virtual and on-vehicle environments.
Automating SDV testing is now closer to reality: a GenAI pipeline turns natural language requirements into runnable test scripts with 89% success.
Testing functionality in Software-Defined Vehicles is challenging because requirements are written in natural language, specifications combine text, tables, and diagrams, while test assets are scattered across heterogeneous toolchains. Large Language Models and Vision-Language Models are used to extract signals and behavioral logic to automatically generate Gherkin scenarios, which are then converted into runnable test scripts. The Vehicle Signal Specification (VSS) integration standardizes signal references, supporting portability across subsystems and test benches. The pipeline uses retrieval-augmented generation to preselect candidate VSS signals before mapping. We evaluate the approach on the safety-relevant Child Presence Detection System, executing the generated tests in a virtual environment and on an actual vehicle. Our evaluation covers Gherkin validity, VSS mapping quality, and end-to-end executability. Results show that 32 of 36 requirements (89\%) can be transformed into executable scenarios in our setting, while human review and targeted substitutions remain necessary. This paper is a feasibility and architectural demonstration of an end-to-end requirements-to-test pipeline for SDV subsystems, evaluated on a CPDS case in simulation and Vehicle-in-the-Loop settings.
