Search papers, labs, and topics across Lattice.
This paper introduces Noise2Fret, a novel diffusion model for audio-to-tablature transcription that addresses the dual challenges of accurate pitch detection and playable fingering assignment. By incorporating five auxiliary losses related to musical and physical constraints into the training objective, the model significantly enhances transcription accuracy while maintaining computational efficiency. Experimental results on the GuitarSet and GOAT datasets reveal that Noise2Fret outperforms existing methods, showcasing the importance of integrating playability into the transcription process.
Transcribing guitar audio to tablature just got smarter鈥擭oise2Fret integrates musical constraints to boost accuracy and efficiency.
Guitar tablature transcription requires not only accurate pitch detection but also assigning each note to a specific string-fret position, as the same pitch can be played at multiple fretboard positions. Existing approaches treat this as a standard classification problem, ignoring the musical and physical constraints that govern playable fingering sequences. We propose Noise2Fret, a diffusion model for audio-to-tablature transcription that generates tablature through a continuous latent representation of discrete fret and string targets, conditioned on spectral and audio features. To bridge the gap between pitch accuracy and physical playability, we introduce five auxiliary losses encoding Pitch-Class Distance, Positional Distance, Circle-of-Fifths Distance, String Similarity, and Hand-Span Feasibility directly into the training objective. Experiments on GuitarSet and GOAT datasets demonstrate that the model outperforms baselines while remaining computationally more efficient, and that the auxiliary losses yield consistent gains over the standard training objective.
