Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces CITRAS-FM, a compact time series foundation model designed for covariate-informed zero-shot forecasting, addressing the limitations of existing models that struggle with computational efficiency and diverse variable types. By leveraging a novel Shifted Attention mechanism within a patch-based, decoder-only Transformer architecture, CITRAS-FM effectively incorporates exogenous covariates throughout the forecasting process. Experimental results across 100 tasks demonstrate that CITRAS-FM achieves state-of-the-art zero-shot forecasting accuracy among models with fewer than 10 million parameters, while maintaining real-time CPU inference speeds under 0.1 seconds.
CITRAS-FM achieves state-of-the-art zero-shot forecasting accuracy with only 7 million parameters, redefining efficiency in time series modeling.
Pretrained time series foundation models (TSFMs) have enabled zero-shot forecasting on unseen target series. However, existing TSFMs often incur high computational cost and provide limited support for diverse variable types, often failing to account for covariates that exogenously influence target variability. To address these challenges, we propose CITRAS-FM, a tiny 7M-parameter TSFM that supports univariate, multivariate, and covariate-informed zero-shot forecasting with real-time CPU inference. Built on a patch-based, decoder-only Transformer, CITRAS-FM introduces Shifted Attention into the cross-variate module to effectively exploit known covariates accessible throughout the forecast horizon. Moreover, to enable covariate-aware pretraining despite the scarcity of covariate-rich corpora, we propose CovSynth, which synthesizes realistic covariates from decomposed components of target series. Experiments on fev-bench, spanning 100 tasks across various settings, demonstrate that CITRAS-FM achieves state-of-the-art zero-shot accuracy among sub-10M TSFMs while delivering sub-0.1-second CPU inference, offering a strong balance between forecasting accuracy and real-time deployability.