Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces EviRover, an agentic perception system designed to overcome the limitations of one-shot visual prediction by actively seeking additional information beyond an initial glance. To enable this, they developed novel data generation pipelines (EviRover-SFT-5K and EviRover-RL-12K) and a human-verified benchmark (EviLens) for training and evaluation. The resulting EviRover agent significantly outperforms its backbone and achieves competitive performance on various visual perception tasks, demonstrating the efficacy of interactive perception.
Visual perception agents can achieve significant performance gains by actively seeking information beyond a single glance, outperforming static models by up to 30 points on challenging benchmarks.
Visual perception is conventionally formulated as a one-shot prediction from a single glance at the image, under the assumption that the image content and the model's parametric knowledge suffice to resolve the query. This assumption often fails in real-world scenarios that hinge on fine-grained visual details or require knowledge-intensive and up-to-date information. We term such cases perception under insufficient evidence and formulate perception as an agentic process that can obtain information beyond a single glance. To address the absence of data for this setting, we design two dedicated data generation pipelines, yielding EviRover-SFT-5K and EviRover-RL-12K for training. We further construct EviLens, a human-verified benchmark comprising 688 instances across five perception categories. Building on these data, we present EviRover, to our knowledge the first perception agent explicitly trained to resolve perceptual queries through interaction, using supervised fine-tuning followed by agentic reinforcement learning. Experiments show that the 4B EviRover outperforms its backbone by 30 points on average on EviLens, reaching performance comparable to advanced proprietary models. The gains transfer beyond EviLens to WebEyes, conventional perception benchmarks, and general multimodal benchmarks, including a 15-point improvement on BrowseComp-VL. All code, models, and data are released.