Search papers, labs, and topics across Lattice.
This paper introduces RegulaRAG, a novel Retrieval-Augmented Generation (RAG) pipeline designed to generate regulation-compliant test scenarios for automotive safety systems by effectively grounding outputs in complex regulatory standards. By employing SmartChunking and reference-aware enrichment through graph traversal, the system significantly enhances the retrieval and generation process, achieving a Meta-Score of 82.99—43% higher than the closest competitor. The methodology demonstrates robustness and efficiency, maintaining performance stability even as the source corpus expands, contrasting sharply with other RAG systems that falter under similar conditions.
RegulaRAG outperforms existing RAG systems by 43% in generating regulation-compliant scenarios while using significantly fewer tokens, showcasing a breakthrough in efficiency and effectiveness.
Generating regulation-compliant test scenarios is essential for validating safety-critical automotive systems, yet Large Language Models (LLMs) struggle to ground outputs in long, hierarchical standards. We present RegulaRAG, a Retrieval-Augmented Generation (RAG) pipeline that couples SmartChunking, reference-aware enrichment of paragraphs and tables via graph traversal, with Smart Retrieve&Rerank over these enriched units. To test our system, we evaluate on a manually curated dataset covering all scenarios in UN Regulation No. 152 (AEBS). Our study comprises: (i) a three-step progressive search that identifies near-optimal retrieval parameters without exhaustive grid search; (ii) head-to-head comparisons against five baseline RAG systems; and (iii) a robustness stress test that scales the source corpus with distractor content. Outputs are evaluated using a customized penalized scoring metric. Across all experiments, RegulaRAG achieves the highest average Meta-Score (82.99), outperforming the next-best system by 43% (NoRAG: 57.94), while operating at 14k-25k tokens per query versus up to 500k for graphcentric baselines. It maintains strong performance, remaining stable even as the number of regulatory sources grows, whereas competing RAG systems degrade sharply in both quality and robustness.
