Search papers, labs, and topics across Lattice.
This paper introduces SearchEyes, a novel framework for training multimodal search agents that addresses the disconnect between training data, search environments, and reward signals by integrating them into a unified simulated search world. Utilizing a typed knowledge graph, SearchEyes employs Perception-Knowledge Chains (PKC) to create constrained multi-hop paths that retain critical metadata, enabling effective step-level reward assignment through Hop-Anchored Policy Optimization (HaPO). The results demonstrate that SearchEyes outperforms existing open-source multimodal search agents, achieving an average improvement of 6.2 points over the strongest baseline across six benchmarks.
SearchEyes achieves state-of-the-art performance in multimodal search by unifying training data, environments, and rewards into a cohesive simulated world.
Training multimodal search agents to perform multi-hop reasoning remains challenging due to a fundamental structural disconnect: existing pipelines construct training data, search environments, and reward signals independently, causing synthesized structural metadata to be discarded, environments to rely on irreproducible external engines, and RL rewards to remain sparse at the trajectory level. We present \textbf{SearchEyes}, which uses a typed knowledge graph as the backbone of a \emph{simulated search world} that unifies all three components. We propose \textbf{Perception-Knowledge Chains (PKC)} to sample constrained multi-hop paths over the visual-knowledge intersection of Wikidata5M, retaining hop-level entity metadata that simultaneously defines a self-contained search world and step-level reward anchors. We further propose \textbf{Hop-Anchored Policy Optimization (HaPO)}, which reuses these anchors for step-level credit assignment without a separately trained process reward model. Experiments on six multimodal knowledge-intensive benchmarks show that SearchEyes achieves state-of-the-art performance among open-source multimodal search agents, with SearchEyes-27B improving over the strongest open-source baseline by 6.2 points on average.%
