Search papers, labs, and topics across Lattice.
This paper introduces LLM-MLFFN, a novel architecture for autonomous vehicle driving behavior classification that integrates numerical time-series modeling with semantic abstraction using large language models. The method extracts multi-level features (statistical, behavioral, dynamic) and transforms raw data into high-level semantic features using LLMs, which are then fused using a dual-channel multi-level feature fusion network with weighted attention. Experiments on the Waymo Open Trajectory Dataset demonstrate that LLM-MLFFN achieves over 94% classification accuracy, outperforming existing machine learning models.
LLMs can boost autonomous driving behavior classification accuracy to over 94% by fusing numerical time-series data with high-level semantic features.
Accurate classification of autonomous vehicle (AV) driving behaviors is critical for safety validation, performance diagnosis, and traffic integration analysis. However, existing approaches primarily rely on numerical time-series modeling and often lack semantic abstraction, limiting interpretability and robustness in complex traffic environments. This paper presents LLM-MLFFN, a novel large language model (LLM)-enhanced multi-level feature fusion network designed to address the complexities of multi-dimensional driving data. The proposed LLM-MLFFN framework integrates priors from largescale pre-trained models and employs a multi-level approach to enhance classification accuracy. LLM-MLFFN comprises three core components: (1) a multi-level feature extraction module that extracts statistical, behavioral, and dynamic features to capture the quantitative aspects of driving behaviors; (2) a semantic description module that leverages LLMs to transform raw data into high-level semantic features; and (3) a dual-channel multi-level feature fusion network that combines numerical and semantic features using weighted attention mechanisms to improve robustness and prediction accuracy. Evaluation on the Waymo open trajectory dataset demonstrates the superior performance of the proposed LLM-MLFFN, achieving a classification accuracy of over 94%, surpassing existing machine learning models. Ablation studies further validate the critical contributions of multi-level fusion, feature extraction strategies, and LLM-derived semantic reasoning. These results suggest that integrating structured feature modeling with language-driven semantic abstraction provides a principled and interpretable pathway for robust autonomous driving behavior classification.
