Search papers, labs, and topics across Lattice.
The paper introduces Coarse-to-Fine Multimodal Synthesis (CFMS), a two-stage framework for tabular reasoning that combines MLLM-based visual perception with symbolic reasoning. In the coarse stage, MLLMs synthesize a multi-perspective knowledge tuple from the table and question, which then guides a symbolic engine in the fine stage to perform targeted operations. Experiments on WikiTQ and TabFact show CFMS achieves competitive accuracy, especially with large tables and smaller backbone models.
Tabular reasoning gets a boost: decoupling high-level visual perception from granular symbolic reasoning yields better accuracy, especially on large tables, even with smaller models.
Reasoning over tabular data is a crucial capability for tasks like question answering and fact verification, as it requires models to comprehend both free-form questions and semi-structured tables. However, while methods like Chain-of-Thought (CoT) introduce reasoning chains, purely symbolic methodes are inherently limited by their blindness to holistic visual patterns. To address this, we propose the Coarse-to-Fine Multimodal Synthesis framework (CFMS), a novel two-stage paradigm that hierarchically decouples high-level visual perception from granular symbolic reasoning. In the Coarse Stage, CFMS leverages the Multimodal Large Language Models (MLLMs) to perform a one-time synthesis of a multi-perspective knowledge tuple. This tuple subsequently serves as a dynamic reasoning map to guide the fine stage, where a symbolic engine executes a targeted and efficient sequence of iterative operations over the table. Extensive experiments on the WikiTQ and TabFact benchmarks demonstrate that CFMS achieves competitive accuracy. The framework exhibits particular robustness when handling large tables and when instantiated with smaller backbone models, validating its effectiveness and generalizability.
