Search papers, labs, and topics across Lattice.
This study explores the effectiveness of modality dropout in fusing three data types鈥攗nstructured service complaints, high-dimensional sensor telemetry, and Diagnostic Trouble Codes (DTCs)鈥攆or diagnosing heavy-duty vehicle engine components. By employing 5-fold cross-validation across various model configurations, the authors reveal that while naive fusion yields modest improvements, modality dropout significantly enhances performance, achieving an accuracy of 68.8% on text and DTC fusion. The findings indicate that the optimal modality for diagnosis varies by fault type, highlighting the nuanced interplay between different data sources in industrial diagnostics.
Modality dropout not only boosts diagnostic accuracy but also reveals that the best data source varies by fault type, challenging conventional wisdom in multi-modal learning.
Heavy-duty vehicle diagnostics generate three disconnected data modalities: unstructured multi- lingual service complaints, high-dimensional sensor telemetry with over 80% missing values, and Diagnostic Trouble Codes (DTCs). We investigate whether fusing these modalities improves engine component classification on a proprietary dataset from a major truck manufacturer. Through 5-fold cross-validation across multiple model configurations spanning three model families on five engine component classes (885 samples, the full cross-database matched population for this manufacturer), we find that naive fusion provides modest gains over text alone (65.3%). However, modality dropout during training, which randomly disables entire modalities per batch, forces the network to exploit weaker inputs and achieves 68.8% accuracy on text+DTC fusion (weighted F1: 0.67), a 3.5-point improvement over text-only (65.3%, weighted F1: 0.64) and the best result across all methods including logistic regression and gradient-boosted trees. Per-class analysis shows that the dominant modality varies by fault type: text describes symptoms, DTCs encode structured fault signals, and sensors measure physical state. On intake/exhaust faults, sensors alone reach 93% where text achieves 80%. On fuel system faults, fusion with modality dropout nearly triples accuracy from 15% to 38% over text alone. To our knowledge, this is the first application of three-way modality fusion combining text, sensors, and fault codes in industrial vehicle diagnostics.
