Search papers, labs, and topics across Lattice.
This paper introduces Power-Law Self-Correlation Enhanced Attention (PL-SCEA), a method that reconfigures the attention mechanism of frozen Vision Foundation Models (VFMs) to better suit few-shot industrial anomaly detection tasks. By emphasizing token-adaptive self-correlations and utilizing positive-correlation filtering without additional trainable parameters, PL-SCEA enhances the localization of anomalies while retaining semantic context. The proposed framework achieves competitive performance on benchmark datasets, demonstrating that aligning attention mechanisms with task-specific requirements can significantly improve anomaly localization capabilities.
Reconfiguring attention in frozen Vision Foundation Models can dramatically enhance their ability to detect anomalies in industrial settings, achieving superior localization without retraining.
Vision Foundation Models (VFMs) provide transferable patch representations for few-shot industrial anomaly detection, but their attention computation is typically inherited from pretraining objectives centered on semantic aggregation. This creates a potential mismatch: token relations that support semantic recognition may not adequately expose the localized texture and structural deviations required for anomaly localization. We therefore investigate the hypothesis that the attention computation of a frozen VFM can be reconfigured as a task-relevant component of anomaly detection. We instantiate this idea with Power-Law Self-Correlation Enhanced Attention (PL-SCEA), which retains the semantic context of pretrained query-key attention while constructing token-adaptive self-correlations over contextualized value features. Positive-correlation filtering and power-law reweighting then emphasize relations that are salient relative to each token's relational background, without introducing additional trainable attention projections. The resulting features are modeled by a lightweight variational autoencoder that provides a fixed-size reconstruction-based representation of category-specific normality. The two stages serve complementary roles: attention reconfiguration shapes how local relational deviations are represented, while reconstruction-based modeling converts deviations from learned normality into anomaly scores. Across MVTec AD and VisA, the complete framework achieves competitive image-level detection and consistently strong pixel-level localization across the evaluated few-shot settings. Ablations further show that PL-SCEA improves localization with either the VAE or a memory bank under the tested setting. These results support the view that task-aligned attention reconfiguration can improve the anomaly-localization capability of frozen pretrained representations.
