Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for causal discovery in multivariate time series data by employing an inverted causal self-attention mechanism (CSAM) within a transformer architecture. By inverting tokens and inducing sparsity in attention scores, the method effectively captures latent and indirect causal relationships while minimizing spurious correlations. Experimental results demonstrate that this approach significantly outperforms existing methods in identifying accurate causal structures across both linear and nonlinear datasets.
Inverted self-attention reveals hidden causal relationships in multivariate time series, outperforming traditional methods by reducing spurious correlations.
Causal discovery in multivariate time series data is challenging due to complex interactions, high dimensionality, and nonlinear dependencies among variables. Existing methods often struggle to capture these complexities, resulting in inaccurate causal structures. To address this issue, we propose a novel framework that leverages self-attention mechanisms within the transformer architecture for causal discovery. Our approach introduces a novel inverted causal self-attention mechanism (CSAM) that emphasizes latent and indirect causal relationships by inverting tokens and inducing sparsity in attention scores, focusing on significant causal interactions and reducing spurious correlations. Additionally, we develop a global causal algorithm to identify global causal links, providing a holistic metric for causal influence, along with a causal verification module to ensure robustness in the identified causal relationships, enhancing the reliability of our framework. Experiments on both linear and nonlinear datasets, along with ablation studies and sensitivity analyses, show that our framework outperforms existing methods, demonstrating its potential for causal discovery in complex multivariate time series.
