Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SimpleTimeBench, a diagnostic suite to evaluate the temporal reasoning capabilities of Time Series Foundation Models (TSFMs), revealing that prominent multivariate TSFMs exhibit significant zero-shot blind spots in fundamental temporal patterns and covariate utilization. Despite their broad benchmark success, these models frequently produce suboptimal forecasts for simple trends, periodicities, and leading indicators, even when fine-tuned. The findings highlight a critical gap between pre-training scale and essential temporal inductive biases, limiting the practical reliability of current TSFMs.
Leading multivariate TSFMs fail basic "unit tests" for temporal logic, underutilizing simple trends and leading indicators even with exogenous covariates.
Despite the success of Time Series Foundation Models (TSFMs) on broad benchmarks, their ability to internalize basic temporal logic, especially in settings supported by exogenous covariates, remains under-examined. We introduce SimpleTimeBench, a diagnostic univariate and multivariate"unit test"suite for primitives such as monotonic trends, periodic signals and leading indicator covariates, scenarios where near-perfect forecasts should be trivial. Surprisingly, prominent multivariate TSFMs (Chronos-2, Moirai and Toto) frequently produce suboptimal zero-shot forecasts for these inputs. While fine-tuning Chronos-2 improves its behaviour on specific tasks, we show that this adaptation degrades performance on other fundamental patterns rather than enhancing its generalizable foundational capabilities. This reveals a gap between pre-training scale and basic temporal reasoning, suggesting that current TSFMs could potentially lack the inductive biases needed to capture simple predictable functions. We further demonstrate that these failures are not merely synthetic curiosities: they persist in real-world sensor forecasting, where TSFMs consistently underutilize leading indicators available in observed covariates. This inability to capture simple relationships limits the practical utility and reliability of current multivariate models.