Search papers, labs, and topics across Lattice.
DocClaw introduces a unified agentic system for intelligent document processing that integrates tasks like OCR, document question answering, and key information extraction into a cohesive interaction model. By leveraging a structured document state and iterative skill invocation, the system allows for the accumulation and refinement of task-relevant information across diverse document processing tasks. Experimental results show that DocClaw achieves competitive performance against both general-purpose vision-language models and specialized task-specific approaches, highlighting its versatility and efficiency.
A single agentic framework can seamlessly tackle multiple intelligent document processing tasks, outperforming specialized models in the process.
Intelligent document processing (IDP) encompasses a broad range of tasks, including optical character recognition (OCR), document question answering (DocQA), and key information extraction (KIE). Despite their distinct objectives, these tasks share a common need to perceive document content, acquire task-relevant information, and progressively refine intermediate results. However, they are typically formulated as separate prediction problems and addressed by task-specific models or processing pipelines. We introduce DocClaw, a unified agentic system that formulates diverse intelligent document processing tasks as a shared process of interaction between an agent and a document. Given a document and a task-specific query, DocClaw follows an appropriate document skill to iteratively identify the information required, invoke relevant tools, and integrate the resulting observations into the desired output. Throughout this process, a structured document state organizes reusable document knowledge and task-specific interaction context, allowing the agent to accumulate, revisit, and progressively refine information as the interaction proceeds. Under this formulation, task-specific requirements are captured by the agent's interpretation of the query objective and the corresponding document skill, while the underlying interaction loop, tool space, and document state are shared across tasks. Extensive experiments across multiple intelligent document processing benchmarks demonstrate that DocClaw effectively handles diverse tasks within a single agentic framework and achieves competitive performance compared with both general-purpose VLMs and task-specific methods.
DAMO