Search papers, labs, and topics across Lattice.
This paper introduces CoverPrune, a novel framework for token pruning in 3D Vision-Language Models (3D VLMs) that shifts the focus from diversity-based selection to coverage preservation. By formulating the token pruning problem as an Optimal Transport (OT) challenge, CoverPrune effectively maintains essential visual evidence while discarding redundant tokens, thus addressing the computational bottlenecks caused by excessive token counts. Extensive evaluations reveal that CoverPrune achieves state-of-the-art token efficiency and robust spatial reasoning performance, even under aggressive pruning conditions.
Coverage-driven token pruning can significantly enhance the efficiency of 3D VLMs without sacrificing reasoning capabilities.
While 3D Vision-Language Models (3D VLMs) have demonstrated remarkable spatial reasoning capabilities, they suffer from massive visual token counts that create severe computational bottlenecks during inference. Existing token pruning methods primarily rely on diversity-based selection, discarding similar tokens to maximize dispersion. However, in 3D environments, this approach frequently drops representative prototype tokens in favor of outliers, breaking the multi-view consistencies and geometric structures essential for spatial reasoning. In this paper, we propose a paradigm shift for 3D VLM token pruning: from maximizing diversity to preserving visual evidence coverage. We introduce CoverPrune, a training-free framework that formulates inference-time token pruning as an Optimal Transport (OT) problem. To overcome the intractable combinatorial subset selection inherent in this formulation, we design the Feature-Spatial-Temporal (FST) transport cost and target capacity, along with an efficient Spatial-Guided Greedy Selection (SGS) algorithm to approximate the OT objective. Furthermore, we propose CoverPrune-Lite, an accelerated variant utilizing spatially structured local matching for minimal overhead. Extensive experiments across multiple 3D visual-spatial reasoning benchmarks demonstrate that our methods achieve state-of-the-art token efficiency, maintaining robust reasoning performance even under highly aggressive pruning budgets. Visit our project website at https://github.com/Brucess/CoverPrune.
