Search papers, labs, and topics across Lattice.
This paper introduces ODTQA-FoRe, a novel dataset designed for Open-Domain Tabular Question Answering focused on future data forecasting and reasoning, specifically using real estate data. The authors tackle significant challenges such as retrieving accurate historical data and enhancing LLMs' forecasting capabilities through a new framework called TimeFore, which employs a collaborative approach involving a Retriever, a Forecaster, and an Analyzer. Experimental results reveal that TimeFore significantly improves the accuracy and consistency of predictions in complex tabular question-answering scenarios.
Future-oriented reasoning in tabular question answering is now feasible with the introduction of a dataset and framework that outperforms existing LLM capabilities.
The rapid development of LLMs has significantly advanced tabular question answering, but most systems cannot perform future-oriented numerical prediction. To address this gap, we introduce a novel task, Open-Domain Tabular Question Answering for Future Data Forecasting and Reasoning, and propose the first dataset to cover time-series forecasting and forecast-based reasoning scenarios using real estate data. This task poses challenges in retrieving precise historical data, overcoming the forecasting limitations of LLMs, and standardizing responses for diverse queries. To solve the above challenges, we propose TimeFore, an LLM agent-based framework that decomposes the problem into three collaborative roles: a Retriever autonomously generates SQL to fetch data, a Forecaster invokes external time-series models for higher accuracy, and an Analyzer synthesizes the results to construct a precise and consistent final answer. Extensive experiments demonstrate the effectiveness of our TimeFore.
