Search papers, labs, and topics across Lattice.
This paper introduces a "Cluster-then-Summarize" pipeline for generating test specifications that meet Automotive SPICE SWE.6 requirements, addressing the challenges of scaling to thousands of requirements. By embedding requirements with sentence transformers, clustering them using UMAP and HDBSCAN, and applying a multi-level map-reduce summarization algorithm, the approach preserves inter-requirement dependencies and enhances test coverage. Evaluation shows that this method significantly improves integration test coverage and maintains fidelity in summarization, making it a viable solution for automating complex automotive software testing.
Automating test specification generation can dramatically reduce engineering time while improving coverage, addressing a critical bottleneck in automotive software development.
Generating test specifications that satisfy Automotive SPICE SWE.6 requirements becomes increasingly challenging and time-consuming as projects scale to thousands of requirements. Because this manual process often consumes weeks of engineering effort, automation becomes a critical necessity. However, standard Large Language Model (LLM) approaches struggle at scale: processing requirements individually discards vital inter-requirement dependencies, while feeding entire corpora at once exceeds context-window limits, leading to incomplete integration coverage and redundant test cases. This paper presents a novel "Cluster-then-Summarize" pipeline that addresses these limitations through three-stages. Requirements are embedded using sentence transformers and grouped using UMAP dimensionality reduction followed by HDBSCAN density-based clustering. This grouping utilizes an automatic minimum cluster size selection driven by a quality criterion combining normalized Silhouette and Calinski-Harabasz scores. A multi-level map-reduce summarization algorithm then distills each cluster into concise, domain-conformant descriptions while preserving quantitative thresholds and safety integrity levels. The pipeline exploits the derived cluster topology to generate test specifications at two levels: individual requirement verification and cluster-level integration tests that verify cross-requirement feature behavior. A nearby-cluster context mechanism provides bounded cross-feature awareness during each LLM call, and Retrieval-Augmented Generation grounds all outputs in ISO 26262 and ASPICE standards. Evaluation on automotive requirement datasets of varying scale demonstrates that the cluster-aware approach improves integration test coverage and maintains summarization fidelity compared to baseline methods while scaling efficiently to thousands of requirements.
