Search papers, labs, and topics across Lattice.
This paper introduces EvoGraph-R1, a self-evolving GraphRAG framework that addresses the limitations of static knowledge graphs in retrieval-augmented generation for multimodal large language models. By framing retrieval as a Markov Decision Process, the framework allows agents to dynamically interact with and refine the hypergraph structure, enabling continuous integration of new evidence and correction of errors. Experimental results show that EvoGraph-R1 significantly outperforms existing RAG baselines in accuracy, coverage, and traceability across multimodal visual question answering and text question answering tasks.
Self-evolving knowledge graphs can dramatically enhance multimodal reasoning by continuously adapting to new information and correcting errors in real-time.
Retrieval-augmented generation (RAG) has emerged as a critical paradigm for grounding Multimodal Large Language Models (MLLMs) in external knowledge. Recent GraphRAG methods introduce structured entity-relation graphs to improve retrieval and reasoning. However, they remain limited by treating knowledge graphs as static data structures built offline and queried in a single pass. This static paradigm misaligns with the interactive, iterative nature of knowledge-intensive reasoning, creating three bottlenecks: (i) text-centric fragmentation that impedes cross-modal reasoning, (ii) frozen structures unable to incorporate new evidence or correct errors, and (iii) rigid single-pass retrieval without adaptive refinement. To overcome these limitations, we introduce EvoGraph-R1, a self-evolving GraphRAG framework that reconceptualizes knowledge graphs as dynamic environments shaped through agent interactions. We formulate retrieval as a Markov Decision Process (MDP) where the agent observes the graph state and executes actions to query (GraphRetrieve), expand (WebSearch), refine (GraphEdit), or terminate (Answer) the reasoning. These actions reshape the hypergraph structure and generate feedback signals that guide subsequent evolution. Through this closed loop, the hypergraph evolves by integrating new evidence, correcting errors, and refining structure to support multi-hop reasoning. Experiments on multimodal VQA and text QA benchmarks demonstrate substantial improvements over existing RAG baselines in accuracy, coverage, and traceability, establishing self-evolving knowledge graphs as a fundamental paradigm across modalities.
