Search papers, labs, and topics across Lattice.
This paper introduces KeepAD, a defect-preserving token pruning framework designed for efficient zero-shot anomaly detection by intelligently selecting which tokens to retain during processing. By employing a combination of coverage-preserving selection in shallow layers and anomaly-aware routing in deeper layers, KeepAD minimizes the risk of losing critical anomaly information while significantly reducing computational overhead. Experimental results demonstrate that KeepAD can maintain high detection performance while achieving a remarkable 7.9脳 speedup compared to existing CLIP-based methods, with token retention ratios dropping below 20%.
KeepAD achieves a 7.9脳 speedup in zero-shot anomaly detection while preserving crucial defect information, challenging the trade-off between efficiency and accuracy.
Zero-shot visual anomaly detection has achieved remarkable progress, with recent vision-only approaches further improving performance while simplifying the inference pipeline. However, existing methods typically perform dense computation over all images and spatial tokens, despite the fact that normal samples dominate real-world scenarios and anomalies usually occupy only small regions. Token pruning offers a promising solution, but introduces an asymmetric pruning risk in anomaly detection: retaining normal tokens mainly incurs redundant computation, whereas removing anomalous tokens may eliminate the only evidence for detection and localization. This risk is particularly severe in early layers, where pruning provides the greatest computational benefit but anomaly semantics remain unreliable. We propose KeepAD, a defect-preserving token pruning framework that formulates token selection as high-recall, anomaly-aware routing. In shallow layers, KeepAD combines coverage-preserving selection over local $2\times2$ patch neighborhoods with deterministic anomaly rescue to reduce the risk of discarding subtle defects. In deeper layers, frozen normal and abnormal prototypes guide pruning under an image-adaptive token budget, aggressively removing low-risk normal tokens while preserving local anomaly evidence. Dense-to-sparse self-distillation further supervises early token routing without introducing additional inference overhead. Experiments on six industrial and seven medical zero-shot anomaly detection benchmarks show that KeepAD reduces the token retention ratio to below $20\%$, while limiting the average degradation in image-level and pixel-level AUROC to within $2.7$ percentage points. At the most aggressive operating point, KeepAD achieves a $7.9\times$ speedup over the strongest CLIP-based baseline.
