Search papers, labs, and topics across Lattice.
This paper introduces Q-Guide, an innovative approach to multimodal visual question answering (VQA) that enhances the model's ability to acquire evidence by iteratively directing its perception based on the specific needs of the question. By allowing the model to spend additional computational resources on identifying and retrieving relevant information, Q-Guide significantly outperforms traditional fixed encoding methods, achieving a 65.0% accuracy on DocVQA2026 compared to 40.0% for direct prompting. The findings reveal that accuracy improves with a more deliberate perception strategy, emphasizing the importance of targeted evidence acquisition over complex control mechanisms.
Iterative perception can boost document VQA accuracy by over 25%, proving that smarter evidence acquisition trumps mere model size.
Multimodal LLMs can see a document, but they often can't read it reliably. Small text, tables, visual cues, and topological elements still trip them up under direct visual inference, even when the page is already sitting in the model's context. Most document-VQA systems treat perception as fixed: they encode the page once, ask the question, and answer from whatever the model happened to extract in that single fast pass. We think document VQA needs slower, more deliberate perception: rather than answering from one fixed encoding, the model should spend a bit of extra compute at inference time working out what to look at next, and only then answer. We build this into \textbf{Q-Guide}, a small agent that reads a question, works out what evidence it is still missing, and calls targeted tool(s) to recover it---reading text where text is needed, zooming in where detail is needed, or grounding a region where position matters. On DocVQA2026 and Manga109, Q-Guide outperforms both direct prompting and recent multi-agent document systems ($65.0\%$ vs.\ $40.0\%$ on DocVQA2026, $32.4\%$ vs.\ $24.4\%$ on Manga109), and the improvement holds across three Claude backbones (Opus 4.6, Sonnet 4.6, and Opus 4.5). We find that accuracy scales with the perception budget---most of the gain appears within two to three deliberate rounds---and that the gain comes from directing perception to the right place, not from complex control logic: adding planners, routers, or multiple collaborating agents does not help.
