Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Standard vision models suffer acute performance drops on high-resolution cluttered scenes because uniform downsampling obliterates critical fine-grained details. To fix this, CF-GAP acts as a task-driven front-end that actively and iteratively refines limited-view glimpses across an image based on target specifications before passing localized high-resolution crops to downstream detectors. The framework boosts Average Precision by up to 20% across multiple detectors on the HR-InsDet and Robotools benchmarks, enabling lightweight architectures to surpass far larger full-image models.
Lightweight vision models can outperform massive baselines simply by learning where to look—boosting detection accuracy by up to 20% AP via task-guided, coarse-to-fine active glimpses instead of brute-force downsampling.
State-of-the-art vision models process images in their entirety, lacking the ability to selectively zoom in on relevant regions. This limitation is particularly acute in scenarios where processing must be conditioned on a specific task - such as instance detection, which requires localizing a specific object in a high-resolution, cluttered scene. In such settings, critical details are easily lost as images are often resized to match the model dimensions and computational constraints. We introduce Coarse-to-Fine Glimpse-based Active Perception (CF-GAP), a task-driven front-end that enhances high-resolution processing of existing instance detectors. CF-GAP selectively directs a sequence of limited view glimpses across the scene, utilizing task information to iteratively refine focus on the most relevant regions. These localized regions are then processed at high resolution by a downstream instance detector. By avoiding full-image processing and eliminating irrelevant confounding information, CF-GAP improves Average Precision (AP) by up to 20% across various state-of-the-art instance detectors on the HR-InsDet and Robotools benchmarks, while further enabling lightweight detectors to outperform their larger counterparts.