Search papers, labs, and topics across Lattice.
This paper introduces MARDoc, a Memory-Aware Refinement Agent framework designed to enhance multimodal long-document question answering by employing three specialized agents: an Explorer for retrieval, a Refiner for evidence structuring, and a Reflector for feedback on evidence sufficiency. By decoupling the QA process and utilizing a dynamically updated structured memory, MARDoc effectively minimizes context noise while maintaining critical facts and their logical relationships. Experimental results on MMLongBench-Doc and DocBench reveal that MARDoc significantly outperforms baseline models, demonstrating the advantages of structured memory in complex document QA tasks.
MARDoc's innovative use of structured memory allows for clearer reasoning in long-document QA, outperforming traditional methods that struggle with context dilution.
Iterative retrieval-reasoning agents have recently shown promise for multimodal long-document question answering. However, most existing systems maintain a single growing context that mixes retrieval traces, observations, and intermediate reasoning. As interactions accumulate, key evidence becomes scattered and diluted, making multi-hop reasoning noisy. We propose MARDoc, a Memory-Aware Refinement Agent framework that decouples long-document QA into three specialized agents: an Explorer for multi-granularity multimodal retrieval, a Refiner for distilling interaction traces into structured evidence and reasoning memories, and a Reflector for checking evidence sufficiency and providing targeted feedback. Across iterations, the agents rely on a dynamically updated structured memory rather than a full accumulated interaction history. This design reduces context noise while preserving answer-critical facts and their logical dependencies. Experiments on MMLongBench-Doc and DocBench show that MARDoc achieves strong results, outperforming same-backbone baselines and demonstrating the effectiveness of structured memory for agentic document QA.
