Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces Operation-R1, a framework that trains lightweight LLMs (Qwen-4B/1.7B) to generate data preparation pipelines for Table Question Answering (TQA) in a single inference step, addressing the latency and cost issues of multi-step approaches. Operation-R1 employs a self-supervised rewarding mechanism for fine-grained pipeline supervision and variance-aware group resampling to stabilize training. Experiments on benchmark datasets demonstrate that Operation-R1 achieves significant accuracy gains over multi-step baselines while reducing table size and monetary cost.
Lightweight LLMs can now generate high-quality data preparation pipelines for TableQA in a single step, outperforming multi-step approaches while slashing costs and latency.
Table Question Answering (TQA) aims to answer natural language questions over structured tables. Large Language Models (LLMs) enable promising solutions to this problem, with operator-centric solutions that generate table manipulation pipelines in a multi-step manner offering state-of-the-art performance. However, these solutions rely on multiple LLM calls, resulting in prohibitive latencies and computational costs. We propose Operation-R1, the first framework that trains lightweight LLMs (e.g., Qwen-4B/1.7B) via a novel variant of reinforcement learning with verifiable rewards to produce high-quality data-preparation pipelines for TQA in a single inference step. To train such an LLM, we first introduce a self-supervised rewarding mechanism to automatically obtain fine-grained pipeline-wise supervision signals for LLM training. We also propose variance-aware group resampling to mitigate training instability. To further enhance robustness of pipeline generation, we develop two complementary mechanisms: operation merge, which filters spurious operations through multi-candidate consensus, and adaptive rollback, which offers runtime protection against information loss in data transformation. Experiments on two benchmark datasets show that, with the same LLM backbone, Operation-R1 achieves average absolute accuracy gains of 9.55 and 6.08 percentage points over multi-step preparation baselines, with 79\% table compression and a 2.2$\times$ reduction in monetary cost.