Search papers, labs, and topics across Lattice.
The paper introduces SEMixer, a novel MLP-Mixer architecture for long-term time series forecasting that addresses challenges in multiscale pattern modeling. SEMixer employs a Random Attention Mechanism (RAM) to capture diverse time-patch interactions and a Multiscale Progressive Mixing Chain (MPMC) to efficiently stack RAM and MLP-Mixer for effective temporal mixing across scales. Experimental results on 10 public datasets and the 2025 CCF AlOps Challenge demonstrate SEMixer's effectiveness, achieving third place in the latter.
By randomly attending to different time patches and progressively mixing scales, SEMixer achieves state-of-the-art long-term time series forecasting with a lightweight architecture.
Modeling multiscale patterns is crucial for long-term time series forecasting (TSF). However, redundancy and noise in time series, together with semantic gaps between non-adjacent scales, make the efficient alignment and integration of multi-scale temporal dependencies challenging. To address this, we propose SEMixer, a lightweight multiscale model designed for long-term TSF. SEMixer features two key components: a Random Attention Mechanism (RAM) and a Multiscale Progressive Mixing Chain (MPMC). RAM captures diverse time-patch interactions during training and aggregates them via dropout ensemble at inference, enhancing patch-level semantics and enabling MLP-Mixer to better model multi-scale dependencies. MPMC further stacks RAM and MLP-Mixer in a memory-efficient manner, achieving more effective temporal mixing. It addresses semantic gaps across scales and facilitates better multiscale modeling and forecasting performance. We not only validate the effectiveness of SEMixer on 10 public datasets, but also on the \textit{2025 CCF AlOps Challenge} based on 21GB real wireless network data, where SEMixer achieves third place. The code is available at the link https://github.com/Meteor-Stars/SEMixer.
