Search papers, labs, and topics across Lattice.
The paper introduces Temporal-Prior Conditioning (TPC), a novel method for improving LLM-based time series forecasting by treating time as a first-class modality. TPC uses learnable time series tokens that cross-attend to temporal embeddings derived from human-readable temporal descriptors encoded by a frozen LLM at multiple layers, allowing for deeper temporal reasoning. Experiments demonstrate that TPC outperforms full fine-tuning and shallow conditioning strategies, achieving state-of-the-art results in long-term forecasting across various datasets while maintaining a low parameter budget.
LLMs can now forecast time series with state-of-the-art accuracy by explicitly disentangling temporal information and conditioning the model at multiple depths, all while keeping the parameter budget low.
LLM-for-time series (TS) methods typically treat time shallowly, injecting positional or prompt-based cues once at the input of a largely frozen decoder, which limits temporal reasoning as this information degrades through the layers. We introduce Temporal-Prior Conditioning (TPC), which elevates time to a first-class modality that conditions the model at multiple depths. TPC attaches a small set of learnable time series tokens to the patch stream; at selected layers these tokens cross-attend to temporal embeddings derived from compact, human-readable temporal descriptors encoded by the same frozen LLM, then feed temporal context back via self-attention. This disentangles time series signal and temporal information while maintaining a low parameter budget. We show that by training only the cross-attention modules and explicitly disentangling time series signal and temporal information, TPC consistently outperforms both full fine-tuning and shallow conditioning strategies, achieving state-of-the-art performance in long-term forecasting across diverse datasets. Code available at: https://github.com/fil-mp/Deep_tpc
