Search papers, labs, and topics across Lattice.
The paper introduces GUIPruner, a training-free framework to improve the efficiency of high-resolution GUI agents by addressing spatiotemporal redundancy in screenshots and historical trajectories. GUIPruner employs Temporal-Adaptive Resolution (TAR) to reduce historical redundancy using decay-based resizing and Stratified Structure-aware Pruning (SSP) to prioritize interactive foregrounds and semantic anchors while preserving global layout. Experiments on various benchmarks demonstrate that GUIPruner achieves state-of-the-art performance with significant FLOPs reduction (3.4x) and speedup (3.3x) while maintaining high performance on Qwen2-VL-2B.
Achieve real-time, high-precision GUI navigation with minimal resources by pruning redundant visual tokens *without* retraining.
Pure-vision GUI agents provide universal interaction capabilities but suffer from severe efficiency bottlenecks due to the massive spatiotemporal redundancy inherent in high-resolution screenshots and historical trajectories. We identify two critical misalignments in existing compression paradigms: the temporal mismatch, where uniform history encoding diverges from the agent's"fading memory"attention pattern, and the spatial topology conflict, where unstructured pruning compromises the grid integrity required for precise coordinate grounding, inducing spatial hallucinations. To address these challenges, we introduce GUIPruner, a training-free framework tailored for high-resolution GUI navigation. It synergizes Temporal-Adaptive Resolution (TAR), which eliminates historical redundancy via decay-based resizing, and Stratified Structure-aware Pruning (SSP), which prioritizes interactive foregrounds and semantic anchors while safeguarding global layout. Extensive evaluations across diverse benchmarks demonstrate that GUIPruner consistently achieves state-of-the-art performance, effectively preventing the collapse observed in large-scale models under high compression. Notably, on Qwen2-VL-2B, our method delivers a 3.4x reduction in FLOPs and a 3.3x speedup in vision encoding latency while retaining over 94% of the original performance, enabling real-time, high-precision navigation with minimal resource consumption.
Tsinghua AI