Aamir Shakir

Dense retrieval models secretly learn sparse, BM25-compatible vocabularies that can be unlocked with a simple sparse autoencoder, rivaling or exceeding the original dense performance.

Finally, a permissively licensed, high-quality benchmark with over 125,000 relevance judgements is available to rigorously evaluate music information retrieval systems.