Search papers, labs, and topics across Lattice.
This paper introduces GRIDS, a framework leveraging Local Intrinsic Dimensionality (LID) to analyze the geometric impact of natural and adversarial perturbations on self-supervised speech model (S3M) representations. They find that LID increases with low SNR perturbations, but diverges at high SNR, with adversarial examples retaining elevated LID in early layers, correlating with increased WER. Furthermore, layer-wise LID features enable effective anomaly detection in S3Ms, achieving AUROC scores ranging from 0.78 to 1.00.
Adversarial attacks on speech models leave tell-tale geometric fingerprints in early representation layers that can be detected without transcripts.
Self-supervised speech models (S3Ms) achieve strong downstream performance, yet their learned representations remain poorly understood under natural and adversarial perturbations. Prior studies rely on representation similarity or global dimensionality, offering limited visibility into local geometric changes. We ask: how do perturbations deform local geometry, and do these shifts track downstream automatic speech recognition (ASR) degradation? To address this, we present GRIDS, a framework using Local Intrinsic Dimensionality (LID) across layer-wise representations in WavLM and wav2vec 2.0. We find that LID increases for all low signal-to noise ratio (SNR) perturbations and diverges at high SNR: benign noise converges toward the clean profile, while adversarial inputs retain early-layer LID elevation. We show LID elevation co-occurs with increased WER, and that layer-wise LID features enable anomaly detection (AUROC 0.78-1.00), opening the door to transcript-free monitoring in S3Ms.
