Search papers, labs, and topics across Lattice.
This study introduces a novel transductive inference approach for zero-shot audio classification using Contrastive Language-Audio Pretraining (CLAP), leveraging a text-anchored spherical Gaussian-mixture EM to refine audio-embedding statistics from unlabeled test sets. The method significantly enhances classification accuracy across multiple datasets, achieving improvements of 4.6 to 9.2 percentage points over standard zero-shot inference, with a notable peak accuracy of 96.2% on ESC-50 when combined with entropy-guided prompt weighting. Key findings also reveal the necessity of a minimum number of test samples per class for optimal performance, alongside the method's resilience to long-tailed batch distributions, although it struggles in scenarios with low initial classification performance.
Transductive inference can boost zero-shot audio classification accuracy by up to 9.2 points, revealing the power of leveraging unlabeled data structures.
Contrastive language-audio pretraining (CLAP) enables zero-shot audio classification, but standard inference classifies each clip in isolation and ignores the structure of the unlabeled test set. We present the first systematic study of TransCLIP-style transductive inference for CLAP: a text-anchored spherical Gaussian-mixture EM that refines zero-shot posteriors using the audio-embedding statistics of the test batch, with no labels, no gradients, and negligible compute (about 15 ms on one CPU core for 2,000 clips). Across ESC-50, UrbanSound8K, and VocalSound, this consistently improves top-1 accuracy by +4.6 to +9.2 points over the zero-shot baseline (e.g., 89.1 -> 94.8% on ESC-50, 73.8 -> 81.8% on UrbanSound8K). We further show that the gain (i) is governed by a simple operating boundary -- roughly 2.5 test samples per class per batch are required, with diminishing returns beyond ~5; (ii) is complementary to entropy-guided prompt weighting, with the combination reaching 96.2% on ESC-50; and (iii) attenuates but remains positive under long-tailed batches (+4.9 -> +3.1 points at a 20:1 imbalance), which we report as an explicit limitation. We also document a negative result: on TUT Urban Acoustic Scenes 2018, where zero-shot CLAP is near chance, transduction has no signal to amplify.
