Search papers, labs, and topics across Lattice.
Baguan-TS is introduced, a novel 3D Transformer architecture for time series forecasting with covariates that directly operates on raw sequence data, enabling in-context learning without feature engineering. The model addresses calibration and stability issues through target-space retrieval-based local calibration and mitigates output oversmoothing using a context-overfitting strategy. Experiments on public benchmarks and real-world energy datasets demonstrate that Baguan-TS outperforms existing baselines in both point and probabilistic forecasting.
Ditch the feature engineering: Baguan-TS lets you use raw time series sequences directly for in-context forecasting, outperforming traditional methods.
Transformers enable in-context learning (ICL) for rapid, gradient-free adaptation in time series forecasting, yet most ICL-style approaches rely on tabularized, hand-crafted features, while end-to-end sequence models lack inference-time adaptation. We bridge this gap with a unified framework, Baguan-TS, which integrates the raw-sequence representation learning with ICL, instantiated by a 3D Transformer that attends jointly over temporal, variable, and context axes. To make this high-capacity model practical, we tackle two key hurdles: (i) calibration and training stability, improved with a feature-agnostic, target-space retrieval-based local calibration; and (ii) output oversmoothing, mitigated via context-overfitting strategy. On public benchmark with covariates, Baguan-TS consistently outperforms established baselines, achieving the highest win rate and significant reductions in both point and probabilistic forecasting metrics. Further evaluations across diverse real-world energy datasets demonstrate its robustness, yielding substantial improvements.
