Search papers, labs, and topics across Lattice.
This paper introduces MAGE-RAG, a multigranular adaptive graph evidence framework designed for long-document multimodal question answering, addressing the limitations of existing retrieval-augmented generation (RAG) methods that struggle with evidence integration from diverse sources. By constructing an evidence graph that captures complex relationships among text, images, and layout elements, MAGE-RAG optimizes query-time evidence retrieval while managing context noise and inference costs. Experimental results demonstrate that MAGE-RAG achieves state-of-the-art accuracy on LongDocURL and MMLongBench-Doc, highlighting its effectiveness in balancing evidence coverage and relevance in long-document QA tasks.
MAGE-RAG achieves a remarkable 52.75% accuracy on LongDocURL by intelligently balancing evidence coverage and context noise in long-document multimodal QA.
Long-document multimodal question answering requires a system to locate sparse evidence in long PDFs and integrate clues from text, tables, images, charts, and complex layouts. Existing RAG methods mostly rely on fixed Top-k retrieval over text chunks or pages. Text retrieval can compress the context but often loses visual and layout information; page-level visual retrieval preserves the original page, yet it also sends large irrelevant regions to the reader, leading to a static trade-off among evidence coverage, noise, and inference cost. This paper proposes MAGE-RAG, a multigranular adaptive graph evidence framework for long-document multimodal QA. MAGE-RAG uses page retrieval as the entry point for query-time evidence construction. Offline, it builds an evidence graph with page nodes and element nodes, encoding containment, reading order, layout adjacency, section hierarchy, and semantic-neighbor relations. At query time, an online evidence controller iteratively activates, opens, searches, and prunes evidence under explicit budgets. The resulting evidence subgraph is then rendered into structured multimodal reader input, allowing the LVLM to consume compact and relevant evidence within a limited context. On LongDocURL and MMLongBench-Doc, we establish a unified comparison and analysis protocol covering Direct MLLM, Text RAG, Page-level Visual RAG, and Graph/Agentic RAG. Experiments show that MAGE-RAG achieves 52.75 overall accuracy on LongDocURL, and 53.26 accuracy with 51.19 F1 on MMLongBench-Doc. Fine-grained breakdowns, budget-performance curves, ablations, and trace-based analysis further show that query-time evidence subgraph construction can balance dispersed evidence coverage with context-noise control. Our code is available at https://github.com/laonuo2004/MAGE-RAG.git.
