Search papers, labs, and topics across Lattice.
Falcon-X, a novel time series foundation model, addresses limitations in existing models by decoupling variates from the raw space and mapping them into a unified latent prototype space. It introduces Unified Prototype Diff-Attention to align heterogeneous physical quantities and Latent Entity Attention for efficient cross-variate interaction. Evaluations on GIFT-Eval and fev-bench demonstrate state-of-the-art forecasting performance, showcasing its effectiveness in complex multivariate environments.
Achieve state-of-the-art forecasting by mapping heterogeneous time series data into a unified latent space, enabling nuanced interaction modeling.
Time series foundation models (TSFMs) are transforming the forecasting paradigm through large-scale cross-domain pretraining. However, most existing TSFMs remain univariate, and recent efforts to enable cross-variate modeling still operate directly within the raw variate space. This design introduces fundamental limitations in semantic alignment and relational expressivity. Specifically, raw-space group mixing lacks a dedicated mechanism to align heterogeneous physical quantities, while standard non-negative attention fails to capture the complex synergistic and antagonistic interactions ubiquitous in real-world systems. To address these challenges, we propose Falcon-X, decouples variates from the raw space and maps them into a unified latent prototype space. Falcon-X employs a Unified Prototype Diff-Attention mechanism that explicitly evaluates both positive and negative semantic affinities to explicitly align heterogeneous variates. Cross-variate interactions are then efficiently performed within this shared space via Latent Entity Attention, naturally facilitating zero-shot structural transfer. Finally, a Variate Reassembly Router robustly reconstructs variate-specific trajectories via a request-and-dispatch mechanism. Extensive evaluations on the GIFT-Eval and fev-bench benchmarks demonstrate that Falcon-X achieves state-of-the-art forecasting performance, offering a principled and scalable paradigm for complex multivariate environments. Falcon-X is publicly released to support future research.
