Search papers, labs, and topics across Lattice.
This paper introduces VIG-RL, a novel framework that enhances Verified Image Grounding by treating the search-selection-insertion process as an active decision-making task optimized through reinforcement learning. By employing a dynamic ReAct-style loop and a composite reward system, VIG-RL effectively integrates visual evidence into text responses in a contextually relevant manner. The results show that VIG-RL significantly outperforms traditional static retrieval methods, establishing a new benchmark in the field.
VIG-RL achieves a new state-of-the-art in Verified Image Grounding by dynamically integrating visual evidence into text responses, outperforming static retrieval methods.
In knowledge-intensive scenarios, providing reliable interleaved text-image responses requires Verified Image Grounding (VIG): the precise integration of retrieved authentic visual evidence. Existing retrieval-augmented frameworks predominantly rely on decoupled, static pipelines, inherently failing to dynamically reason about when external knowledge is required and where visual assets should be contextually inserted. To bridge this gap, we propose VIG-RL, an autonomous agentic framework that formulates the search-selection-insertion workflow as an active decision-making process. Operating within a dynamic ReAct-style loop, VIG-RL is optimized via reinforcement learning, guided by a composite reward system that holistically evaluates the agent's step-by-step tool execution and final multimodal alignment. Extensive evaluations demonstrate that VIG-RL establishes a new state-of-the-art, significantly outperforming existing static baselines.
