Search papers, labs, and topics across Lattice.
This paper introduces PTCD, a pretraining framework for time series causal discovery that enhances cross-task generalization. PTCD uses a dual-scale iterative attention mechanism and context-level routing to model temporal causal dependencies and heterogeneous exogenous distributions. By pretraining on synthetic datasets with intervention-based learning and causal mixup, PTCD achieves state-of-the-art performance on out-of-distribution causal discovery and root cause identification tasks.
Transferable causal discovery across diverse time series is now possible thanks to a new pretraining paradigm that learns causal structure from synthetic interventions.
Causal discovery from time series is critical for many real-world applications, such as tracing the root causes of anomalies. Existing approaches typically rely on dataset-specific optimization, making it difficult to transfer their causal discovery capabilities to new time series governed by diverse causal mechanisms. In this paper, we propose \textbf{PTCD}, a novel \textbf{P}retraining framework for \textbf{T}ime-series \textbf{C}ausal \textbf{D}iscovery, which improves cross-task generalization through context-conditioned modeling and transferable causal augmentation. To model complex temporal causal dependencies, PTCD employs a dual-scale iterative attention mechanism to capture window-level causal relationships, and a Gaussian mixture with a context-level routing mechanism to handle heterogeneous exogenous distributions. To further address distribution shifts across causal graphs, PTCD adopts a pretraining paradigm on synthetic datasets that integrates intervention-based learning and a causal mixup strategy, promoting stable causal discovery and stronger generalization. Extensive experiments on multiple real-world out-of-distribution (OOD) datasets demonstrate that PTCD excels in both causal discovery and root cause identification.
