Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces AVA-VLM, an Adaptive Visual Attention-Vision Language Model designed for efficient construction site monitoring by employing a human-inspired coarse-to-fine reasoning strategy. Unlike traditional VLMs that rely on direct QA-style fine-tuning from a single global image, AVA-VLM selectively requests high-resolution local crops only when detailed inspection is necessary, enhancing operational range and reliability. Experimental results demonstrate that AVA-VLM significantly improves performance under challenging conditions while reducing visual-token usage, making it a more efficient solution for in-the-wild applications.
AVA-VLM achieves superior reliability and efficiency in construction site monitoring by mimicking human inspection strategies, requesting high-resolution images only when critical details are needed.
Vision-Language Models (VLMs) are promising for construction-site monitoring, and recent construction-tailored VLMs have primarily adapted pretrained VLMs through direct QA-style fine-tuning from a single global image. We argue that this direct paradigm remains limited for in-the-wild deployment in terms of operational range, reliability under reduced-resolution inputs, and inference efficiency. To address these challenges, we propose AVA-VLM, an Adaptive Visual Attention-Vision Language Model that follows a human-inspired coarse-to-fine reasoning strategy. AVA-VLM first reasons over a low-resolution global image and selectively requests a high-resolution local crop only when detailed inspection is needed, similar to how a human inspector zooms in on hard-to-see yet important areas. We further introduce a region-aware Chain-of-Thought dataset that teaches the model when to inspect, where to crop, and how to use local evidence. Experiments show that AVA-VLM improves reliability under long-distance and reduced-resolution conditions while substantially reducing visual-token usage.