Search papers, labs, and topics across Lattice.
This paper systematically analyzes snapping strategies for automatic music transcription (AMT), focusing on the refinement of note-onset labels from weakly aligned score-audio pairs. By formulating snapping as a per-pitch assignment problem and employing bipartite graph matching, the authors achieve context-aware decisions that significantly enhance onset alignment. Extensive experiments demonstrate that this approach outperforms traditional greedy methods, especially when dealing with coarser initial alignments and wider snapping windows, leading to improved transcription accuracy across various musical contexts.
Context-aware snapping can transform weakly aligned audio-score pairs into high-quality training data, dramatically boosting transcription accuracy.
Precise note-level annotations are critical for training automatic music transcription (AMT) systems, in particular note-onset labels, which form a core component of many recent AMT systems. However, high-quality annotations for real-world recordings are scarce. Sequence-level score--audio alignment methods such as dynamic time warping provide only coarse correspondence, making a local refinement step necessary. This refinement step, known as snapping, adjusts aligned score onsets using peaks in a neural onset posteriorgram and often determines whether weakly aligned score--audio pairs become usable training data at all. Despite its practical importance, snapping is typically treated as a simple post-processing heuristic and implemented with greedy local decisions. We present a systematic analysis of snapping strategies for training instrument-agnostic transcribers, demonstrating that snapping is essential for learning from weakly aligned data. Building on this, we formulate snapping as a per-pitch assignment problem and solve it via bipartite graph matching, yielding context-aware onset decisions under overlapping refinement windows and uncertain initial alignments. Extensive cross-dataset experiments across piano, chamber, and orchestral recordings show improved onset alignment and transcription accuracy over greedy snapping, with gains increasing for wider snapping windows and coarser initial alignments. Qualitative examples are provided on our project page: https://abhirupsaha8.github.io
