Search papers, labs, and topics across Lattice.
This study introduces LogPurifier, a task-agnostic approach designed to clean software logs by identifying and removing irrelevant free-standing messages that clutter critical execution information. By leveraging dependency relationships between log message templates, LogPurifier enhances the clarity and relevance of logs, thereby improving the performance of downstream tasks such as model inference and anomaly detection. The planned empirical evaluation aims to demonstrate significant improvements in both the effectiveness and efficiency of these tasks when using the cleaned logs.
Cleaning logs can drastically enhance the performance of model inference and anomaly detection by eliminating irrelevant noise, leading to more accurate insights from software systems.
Background: Software systems generate logs during execution to record critical events and runtime information for troubleshooting and monitoring. However, in practice, logs often contain significant amounts of redundant and irrelevant information, which can negatively impact the performance of downstream analysis tasks, such as model inference and anomaly detection. Objective: The objective of this study is to clean log data by identifying and removing free-standing messages -- messages that are not relevant to the execution behaviors of interest and are interleaved with messages capturing the system's functional behavior. Method: To address this objective, we propose LogPurifier, a task-agnostic log-cleaning approach based on dependency relationships between log message templates. The paper presents a plan for an empirical evaluation using a controlled experimental design to assess the impact of LogPurifier on the effectiveness and efficiency of two downstream tasks: model inference and anomaly detection.
