Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces VISTA, a visual harness designed to unlock the reasoning capabilities of general-purpose multimodal models in interactive environments by providing long-horizon vision and lossless visual memory. VISTA enables models to actively perceive, retrieve, and reorganize past visual observations, significantly enhancing their ability to solve complex tasks. Notably, VISTA propelled Claude Opus 5.0 to perfect performance on ARC-AGI-3, achieving 100.00 Relative Human Action Efficiency and outperforming human participants in action efficiency.
A simple visual harness transforms a general multimodal model into a perfect reasoner on ARC-AGI-3, completing all games with drastically fewer actions than humans.
We show that multimodal models possess strong reasoning abilities and that an appropriate harness can unlock their potential to solve tasks across diverse interactive environments. We introduce VISTA, a visual harness that gives a general-purpose multimodal model long-horizon vision. VISTA allows the model to directly perceive the environment through visual observations and maintains a lossless visual memory that preserves past observations in their original form. The model can actively retrieve these observations and reorganize its visual input as it reasons. On ARC-AGI-3, VISTA improves Claude Opus 5.0's Relative Human Action Efficiency score from 40.68 to a perfect 100.00, with the model completing all 25 public games using 57.4% fewer actions than first-time human participants. VISTA's simple design also allows it to extend naturally to diverse visual environments with minimal adaptation. Across three additional benchmarks covering a diverse range of visual games and puzzles, it substantially outperforms baselines using the same underlying model with minimal harnesses. Our results highlight VISTA's potential as a general-purpose visual harness for advancing multimodal agents in complex visual environments.
MIT CSAIL