Search papers, labs, and topics across Lattice.
This paper introduces HIEVI-RAG, a hierarchical, evidence-driven framework that enhances long-document understanding by addressing the limitations of existing multimodal Retrieval-Augmented Generation (RAG) systems. By implementing a four-stage pipeline that includes hierarchical question decomposition, coarse visual page retrieval, fine-grained page verification, and memory-guided iterative generation, HIEVI-RAG effectively mitigates issues related to irrelevant distractor pages and dependency on initial retrieval success. Extensive evaluations reveal that HIEVI-RAG outperforms current open-source baselines, achieving an average accuracy improvement of 8.05% over the strongest reported baseline across four benchmarks.
HIEVI-RAG's innovative four-stage reasoning pipeline significantly boosts accuracy in long-document understanding, outperforming existing methods by over 8%.
Retrieval-Augmented Generation (RAG) streamlines long-document understanding by leveraging retrieval mechanisms to restrict input images to a highly curated subset. However, existing multimodal RAG pipelines primarily face two critical challenges: first, standard semantic similarity retrievers frequently fetch topically overlapping yet answer-void distractor pages that mislead downstream generation; second, rigid single-pass pipelines heavily depend on initial retrieval success, where any omission of core evidence inevitably causes cascading errors. To address these challenges, we introduce HIEVI-RAG, a hierarchical, evidence-driven multimodal RAG framework for closed-domain document understanding. HIEVI-RAG systematically factorizes complex queries into a cooperative four-stage pipeline: (1) hierarchical question decomposition to break multi-hop root queries into atomic child questions; (2) coarse visual page retrieval leveraging a multimodal retriever to fetch candidate pages based on semantic similarity; (3) fine-grained page verification via EVIAGENT, a specialized multi-page verifier trained with GRPO to execute cross-page reasoning over multi-image blocks; and (4) memory-guided iterative generation that leverages accumulated sub-question context to execute multi-round, dynamic reasoning over the prioritized sequence. Extensive evaluations across four benchmarks demonstrate the robust efficacy and synergy of our framework, which significantly outperforms existing open-source baselines and exceeds the strongest reported baseline by an average of 8.05% in accuracy.
