Search papers, labs, and topics across Lattice.
This paper presents a novel approach to music identification using a generative transformer that performs the task in a single neural feed-forward pass, contrasting with traditional rule-based search methods. The model, trained on an audio dataset, not only outperforms state-of-the-art acoustic fingerprinting techniques, particularly for short audio segments, but also significantly reduces storage requirements and improves inference latency. Additionally, it effectively rejects queries for unseen tracks, enhancing its applicability in open-set scenarios and minimizing misattribution risks.
Music identification can now be achieved in a single neural pass, outperforming traditional methods and dramatically improving efficiency.
Search, a foundational operation in computer science, maps a query to a matching item in a collection. It is typically implemented as a System-2 like, rule-based pipeline in which a key is computed, an index is probed, and candidates are verified. By contrast, human recognition resembles a System-1 like, associative model of identity recovery, in which even partial cues can trigger a recall without explicitly enumerating, ranking, or even accessing discrete candidates. Here, we show that music sound identification, a difficult search problem, can be performed in a single neural feed-forward pass by a generative transformer. Trained on an audio dataset, the model predicts the corresponding track identifier from a short audio excerpt. This approach surpasses state-of-the-art acoustic fingerprinting, with the largest gains for short audio segments (1 second), demonstrating the method is not only viable but advantageous. Moreover, it reduces external storage to 0.33% of the baseline footprint and improves inference latency by 2.3x (p95). Furthermore, the model can reject queries for unseen tracks, supporting open-set operation while reducing misattribution risk. Using music track identification as an example, this work reframes search, bringing it closer in spirit to human associative recognition and away from algorithmic database lookup.
