Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Multi-Period Pattern Pre-training (MP3), a novel approach designed to enhance spatio-temporal forecasting by addressing the limitations of existing spatio-temporal graph neural networks (STGNNs) in recognizing temporal mirages. MP3 employs a dual innovation strategy: it utilizes edge convolution for multi-period temporal modeling and a causality-enhanced Transformer for cross-period pattern interaction, enabling the identification of complex spatial correlations and dependencies across different time periods. Experimental results demonstrate that MP3 consistently improves forecasting accuracy across five STGNN baselines and real-world datasets, achieving an average reduction of 4.7% in MAE and 5.0% in RMSE.
MP3 reveals that integrating multi-period pattern learning can significantly enhance forecasting accuracy by addressing the challenges posed by temporal mirages in urban data.
Spatio-Temporal forecasting is crucial in diverse fields, such as transportation, climate, and energy. Urban spatio-temporal data exhibits temporal mirage: similar short-window inputs have divergent future trends, and vice versa. Existing spatio-temporal graph neural networks (STGNNs) cannot effectively identify such mirages. We argue that the core reason lies in the short-window inputs that have incomplete period observation, heterogeneous global spatial correlation, and cross-period superposition causality. To bridge this gap, we develop a novel Multi- Period Pattern Pre-training (MP3), a plug-and-play pre-training plugin for distinguishing temporal mirages. MP3 presents two core innovations: (1) The multi-period pattern learning is designed to learn multi-period patterns from long time series. Specifically, multi-period temporal modeling leverages edge convolution to identify different multi-period patterns. Multi-period spatial modeling uses a bottleneck project and a global memory bank to capture heterogeneous global spatial relations efficiently. Cross-period pattern interaction employs a causality-enhanced Transformer to capture dependencies across different period patterns. (2) This plugin can seamlessly integrate into existing STGNN backbones to strengthen their forecasting performance. The experiment on five STGNN baselines across five real-world datasets (including a large-scale dataset CA) verify the effectiveness, superior scalability and strong adaptability of MP3, which brings consistent and robust performance improvements across all evaluated baselines. On average, MP3 reduces the MAE 4.7% and the RMSE 5.0%. The code can be available at https://github.com/YAN-outlook/MP3.