Search papers, labs, and topics across Lattice.
This paper introduces TS-RAG, a novel framework that integrates retrieval-augmented generation (RAG) into time series forecasting by using specially designed reference tokens to merge input data with retrieved similar sequences. The approach addresses the limitations of traditional time series models, which often struggle with small datasets and lack the generative capabilities of larger models. Experimental results show that TS-RAG consistently outperforms existing methods, achieving state-of-the-art results across multiple real-world forecasting benchmarks.
TS-RAG redefines time series forecasting by effectively merging input data with retrieved sequences, leading to unprecedented accuracy improvements.
While deep learning models, particularly transformer-based architectures, have shown impressive performance in time series forecasting, the application of retrieval-augmented generation (RAG) in this domain remains limited. Since RAG has proven effective in enhancing the capabilities of large language models by incorporating relevant external information, retrieving similar time series sequences as references might also improve accuracy in time series forecasting tasks. However, most time series models are constrained by limited training data, smaller parameter scales, and a lack of the extensive generative capabilities found in large language models. Simply concatenating reference sequences into the prompt, as done in language models, may not yield the expected results. To address these challenges, we propose a novel approach, TS-RAG, which leverages RAG to enhance forecasting performance. The framework introduces specially designed reference tokens to effectively fuse information from the input sequence with that from retrieved similar sequences, enabling a more robust capture of complex temporal dynamics. Experimental results demonstrate that TS-RAG achieves consistent state-of-the-art performance across several real-world forecasting benchmarks.
