Search papers, labs, and topics across Lattice.
This paper introduces an explainable multi-LLM ensemble framework for sensor-level fault classification in automotive Hardware-in-the-Loop (HiL) validation, addressing challenges in manual review and rule-based limitations. By leveraging compact evidence representations and combining outputs from heterogeneous large language models, the framework enhances diagnostic robustness and interpretability while achieving significant performance improvements. The Top-3 ensemble configuration outperforms individual models and larger ensembles, achieving a Top-1 accuracy of 0.917 and demonstrating that model complementarity is crucial for effective fault classification.
Coordinated multi-LLM reasoning boosts fault classification accuracy in automotive systems, achieving a remarkable 0.917 Top-1 accuracy while enhancing interpretability.
Automotive HiL validation generates large multivariate test recordings whose analysis remains challenging due to manual review effort, rule-based limitations, and the need for explainable diagnostic decisions. Recent machine-learning and deep-learning approaches have improved fault diagnosis, but they often require large labelled datasets, generalise poorly across operating conditions, and provide limited insight into their predictions. This paper proposes an explainable multi-LLM ensemble framework for sensor-level fault classification in automotive validation. The framework uses compact evidence representations of fault-injection recordings and combines the outputs of heterogeneous large language models to improve diagnostic robustness, ranking quality, confidence reliability, and interpretability. The approach is evaluated on gasoline-engine and electric-vehicle HiL systems across three driving settings and ten single-fault classes. Among the individual models, Mistral Small~24B provides the strongest overall single-model trade-off, achieving 0.903 Top-1 accuracy, 0.887 MCC, and the lowest Brier score of 0.102. The final Top-3 ensemble combines Mistral Small~24B, Qwen2.5~32B, and Phi-4~14B using confidence-weighted voting, improving the scenario-averaged results to 0.917 Top-1 accuracy, 0.913 macro F1, and 0.902 MCC, while also providing the best calibration among the tested ensemble strategies. A Top-5 ensemble does not improve over the Top-3 configuration, indicating that model complementarity is more important than ensemble size. The results show that coordinated multi-LLM reasoning can support robust, calibrated, and engineer-interpretable fault classification for automotive HiL validation.
