Search papers, labs, and topics across Lattice.
D2-ScaleAgent introduces a novel dual-dimensional scaling framework for multi-modal retrieval-augmented generation, enhancing long document understanding by dynamically adjusting computational resources based on query complexity. This agentic approach utilizes a Verifier agent-driven dynamic routing loop that optimizes both retrieval and reasoning processes through adaptive evidence management. Experimental results show that D2-ScaleAgent significantly outperforms existing methods on benchmarks like MMLongBench-Doc and LongDocURL, providing more comprehensive evidence coverage and logical closure in complex document scenarios.
Dynamic scaling in D2-ScaleAgent allows for adaptive retrieval and reasoning, leading to superior long document comprehension compared to traditional fixed workflows.
Multi-modal retrieval-augmented generation (RAG) is a key technique for visually rich long document understanding. Existing multi-modal RAG methods are progressively advancing toward multi-agent systems: they first retrieve relevant pages based on a query, and then iteratively understand information within those pages. However, these methods typically rely on fixed workflows and lack the ability to dynamically scale computation at test time, often leading to insufficient evidence. To address this, we propose D2-ScaleAgent, an agentic framework that introduces a dual-dimensional scaling paradigm for retrieval and reasoning. The core of D2-ScaleAgent is a Verifier agent-driven dynamic routing loop based on the intrinsic difficulty of the query, centered around a continuously updated evidence bank that serves as the agent's dynamic working memory: when retrieval needs to be expanded, the agent routes outward (retrieval scaling), decomposing the query into attributes and performing parallel page retrieval, followed by adaptive pruning to ensure comprehensive evidence coverage. When fine-grained reasoning is required, the agent routes inward (reasoning scaling), dynamically selecting sub-agents with varying granularity and count to extract evidence from pages. Finally, D2-ScaleAgent achieves logical closure over the evidence chain. Extensive experiments demonstrate that D2-ScaleAgent is effective on long and visually rich document benchmarks like MMLongBench-Doc, LongDocURL, etc.
