Search papers, labs, and topics across Lattice.
This paper introduces SpikeLogBERT, a spiking neural network framework designed for energy-efficient log parsing by integrating a spiking transformer architecture with knowledge distillation from a BERT teacher model. The approach significantly reduces computational costs and energy consumption by utilizing sparse spike activations and event-driven processing, achieving a parsing accuracy of 0.99997 on the HDFS dataset. Notably, SpikeLogBERT demonstrates up to 62.6% reduction in estimated energy consumption compared to traditional artificial neural network models.
Achieving 0.99997 accuracy in log parsing while slashing energy consumption by over 62% could revolutionize automated log analysis.
Log parsing is a fundamental step in automated log analysis, transforming raw system logs into structured event templates for downstream tasks such as anomaly detection and system monitoring. Existing log parsing methods range from rule-based and clustering-based approaches to neural models that learn semantic representations from log messages. However, neural approaches typically rely on dense matrix multiplications, which can result in high computational cost and energy consumption. This paper presents SpikeLogBERT, a spiking neural network framework for energy-efficient log parsing. The proposed model integrates a spiking transformer architecture with knowledge distillation from a BERT teacher model, enabling spike-driven computation while preserving semantic representation capability. By leveraging sparse spike activations and event-driven processing, the number of active operations during inference can be significantly reduced. As an initial benchmark study, experiments on the HDFS dataset demonstrate that SpikeLogBERT outperforms ANN-based neural log parsing models with a parsing accuracy of 0.99997, while reducing estimated theoretical energy consumption by up to 62.6% under standard 45nm CMOS assumptions.
