Search papers, labs, and topics across Lattice.
This paper introduces CADE (Contrastive Alignment with Direct Embedding), a novel framework for time-series question answering (TSQA) that addresses the limitations of traditional tokenization methods by directly embedding timesteps into the LLM embedding space. By employing a point-wise linear encoder and a one-directional supervised contrastive loss, CADE preserves critical temporal information while aligning time-series embeddings with semantic language representations. Experimental results on the Time-MQA benchmark show that CADE significantly outperforms existing LLM baselines across six TSQA tasks, demonstrating its effectiveness in enhancing time-series analysis through natural language processing.
CADE eliminates the tokenization bottleneck in time-series question answering, leading to substantial performance gains over existing models.
Recent advances in large language models (LLMs) have given rise to time-series question answering (TSQA), which formulates time-series analysis as natural-language question answering. However, directly feeding raw numerical series into LLMs suffers from a tokenization bottleneck: Byte Pair Encoding fragments continuous values into unstable tokens whose embeddings lack meaningful metric structure, resulting in the loss of magnitude, scale, and trend information. Prior methods use patch-based encoders that split the series into fixed windows, locking in one granularity that breaks patterns and hides exact timesteps, through a separate module that rarely transfers across datasets with different lengths or sampling rates. To address this challenge, we propose CADE (Contrastive Alignment with Direct Embedding), a novel framework for TSQA built upon two key components: direct timestep embedding and semantic alignment. The proposed framework maps each timestep directly into the LLM embedding space through a point-wise linear encoder and MLP projector, preserving exact index-level access while eliminating the need for patching and padding. To further bridge the semantic gap between time-series and language representations, we introduce a novel one-directional supervised contrastive loss that aligns time-series embeddings with frozen class-name text anchors. Experimental results on the public Time-MQA benchmark demonstrate that our framework consistently improves performance across six TSQA tasks, outperforming both open-source and proprietary LLM baselines.
