Search papers, labs, and topics across Lattice.
This study evaluates the effectiveness of pretrained music embeddings for recognizing jazz standards across different performances, addressing the challenges posed by variations in tempo, key, and instrumentation. By comparing a from-scratch trained Harmonic CNN with frozen pretrained representations from music understanding models, the authors find that while the latter yields superior top-$k$ retrieval results, they remain sensitive to performer identity. The introduction of a lightweight contrastive projection helps mitigate this sensitivity, highlighting the potential of jazz standard recognition as a benchmark for music representation models.
Pretrained music embeddings outperform from-scratch models in jazz standard recognition, but their effectiveness is hampered by performer identity.
Recognizing jazz standards from audio is a challenging form of tune-level music retrieval: different performances of the same standard may vary in tempo, key, arrangement, instrumentation, improvisational content, and even whether the head melody is present. We study this problem using a curated subset of the Jazz Trio Database designed for cross-performance standard recognition. We compare a from-scratch trained Harmonic CNN baseline against frozen pretrained music representations from recent music understanding foundation models, using both supervised probing and nearest-neighbor retrieval. Our results suggest that from-scratch spectrogram models overfit strongly to training performances, while pretrained embeddings provide better top-$k$ results but are sensitive to performer identity, which can be partially reduced with a lightweight contrastive projection. Our findings motivate jazz standard recognition as a useful stress test for music representation models and as a step toward retrieval-based standard identification. Project page: https://github.com/cagries/tipofmyear.
