Search papers, labs, and topics across Lattice.
This paper investigates the inefficiencies of uniform token processing in time series language models (TSLMs) by analyzing the distinct information structures of time series and prompt tokens. The authors introduce an adaptive token budgeting framework that leverages frequency-domain characteristics to compress TS tokens while dynamically reducing prompt tokens across model layers. Their experiments reveal that this approach can achieve up to 7.68脳 inference acceleration and improve performance in 78% of tested scenarios, highlighting the potential of asymmetric token compression in enhancing TSLM scalability.
Time series language models can achieve up to 7.68脳 faster inference and improved performance by intelligently compressing tokens based on their information structure.
Large language models (LLMs) have enabled time series (TS) analysis by jointly modeling numerical observations and textual context through a shared token interface. However, TS tokens and prompt tokens exhibit fundamentally different information structures, making uniform token processing inefficient. In this paper, we study token efficiency in TS language modeling from an asymmetric-token perspective. We show that TS tokens have highly uneven spectral contributions, where many tokens share redundant frequency patterns while a small subset preserves critical temporal evidence. We also observe that prompt-token influence attenuates with model depth, suggesting that full prompt retention across all layers is unnecessary. Based on these findings, we develop an adaptive token budgeting framework that compresses TS tokens via frequency-domain structure and progressively reduces prompt tokens across layers. Experiments across forecasting, classification, imputation, and anomaly detection demonstrate up to \textit{\textbf{7.68$\times$}} inference acceleration and performance gains in \textit{\textbf{78\%}} of evaluated settings, showing the effectiveness of asymmetric token compression for scalable TS foundation models.
