Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of various image transformation techniques for malware detection using machine learning, specifically focusing on the application of Gradient-weighted Class Activation Maps (Grad-CAM) for explainability. The researchers found that while Grad-CAM heatmaps can enhance the interpretability of malware classification models, there is a notable trade-off between explanation faithfulness and classification accuracy. A Random Forest model utilizing features from Grad-CAM images achieved a test accuracy of 0.777 across 17 malware families, surpassing the previous benchmark of 0.750, highlighting the nuanced relationship between model performance and interpretability in this domain.
Accuracy and explanation faithfulness in malware detection are at odds, with the most interpretable models yielding only mid-tier performance.
Recent studies have shown that binary-to-image representations can enable effective machine learning-based results for malware detection and classification. However, performance can vary significantly, depending on the technique used to convert binaries to images. Furthermore, the explainability and interpretability of image-based models is largely unexplored within the malware domain. In this research, we employ Gradient-weighted Class Activation Maps (Grad-CAM) as an eXplainable AI (XAI) tool, which we use to analyze eight distinct image types derived from malware samples. We provide quantitative faithfulness and stability metrics for Grad-CAM heatmaps and we compare these heatmaps to High-Resolution Class Activation Mappings (HiResCAM). We also show that Grad-CAM heatmaps can provide useful information for malware classification. Specifically, we show that a Random Forest model trained on features extracted from Grad-CAM images via a MobileNetV2 Convolutional Neural Network (CNN) model achieves a test accuracy of 0.777 across 17 malware families, exceeding a previous benchmark of 0.750 for this same dataset. A key finding of this research is that for the malware image transformations considered, accuracy and explanation faithfulness do not coincide, e.g., image transformation techniques that produce the most faithful explanations yield only mid-tier accuracy.
