Search papers, labs, and topics across Lattice.
This paper identifies and formalizes the problem of multicollinearity-induced instability in post-hoc explanations for intrusion detection systems (IDS). They prove that multicollinearity inflates attribution variance, making explanations non-identifiable, and validate this theorem empirically on the UNSW-NB15 dataset across various model families. The authors introduce the Explanability Fragility Score and propose two mitigation methods: CAA-Filtering for post-hoc stabilization and SHARP, a training-time regularization framework that penalizes attribution instability.
Multicollinearity in cybersecurity datasets can make your AI explanations wildly unstable, even for models with stable predictive performance.
This paper investigates a unexplored yet impactful vulnerability in AI explainability used in intrusion detection (IDS): multicollinearity-induced instability. Despite extensive reliance on post-hoc explainability tools such as SHAP or LIME, the impact of correlated features on explanation robustness is not evaluated. We introduce a formal theorem stating that multicollinearity inflates attribution variance. This demonstrates that explanations and feature importances are non-identifiable under multicollinearity. A suite of comprehensive experiments validates the theorem on a representative benchmark dataset, UNSW-NB15. Four widely used families of models are evaluated, including linear, tree-based, kernel, and neural, across full and pruned feature sets based on VIF and correlation thresholding. We propose the novel metric of Explanability Fragility Score and two novel methods to mitigate it with variable integration complexity. CAA-Filtering focuses on stabilising explanations by grouping attributions of trained models. SHARP is a novel training-time regularisation framework that penalises attribution instability, enabling controllable and monotonic improvement of explainability stability. The findings support stable predictive performance, using Kendall's τ to quantify instability across bootstrapped explanations. This work has direct implications for the trustworthiness and reproducibility of XAI in security-critical contexts, and motivates incorporating multicollinearity mitigations into the IDS pipelines, providing a set of guidelines for practitioners.