Search papers, labs, and topics across Lattice.
This paper introduces a novel method for controllable music retrieval that enhances concept-level editing by addressing the limitations of existing sparse autoencoders (SAEs). By reframing concept attribution as a sparse inversion problem, the authors develop a lightweight, training-free approach that identifies relevant audio features without requiring paired audio-text supervision. The results demonstrate improved alignment with concept-bearing audio examples and a better balance between edit strength and preservation, leading to more precise music retrieval outcomes.
Sparse autoencoders can be effectively leveraged for music retrieval, but traditional methods fail to capture the nuances of audio concepts鈥攖his new approach solves that problem.
Controllable music retrieval lets users find music that is, for example, more ambient, less distorted, or without guitar while preserving the other semantic content of an original seed query. Sparse autoencoders (SAEs) are a promising interface for this kind of concept-level control, but a key problem remains: given a free-form text concept, which sparse features should be edited? In shared multimodal embedding spaces, standard attribution methods often select neurons that match the concept's wording but not the audio examples that express it. This leads to weak or unstable edits: relevant features are missed when concepts are distributed across neurons, while others are selected due to text alignment rather than audio-side structure. We address this with a lightweight, training-free method that recovers a sparse set of audio features whose decoded representation reconstructs the target concept while remaining consistent with audio-space geometry. This reframes concept attribution as a sparse inversion problem rather than a text-side neuron-ranking heuristic. The method requires neither paired audio-text supervision nor SAE retraining. We evaluate this approach in steerable music retrieval and show that the recovered supports align more closely with concept-bearing audio examples and achieve a stronger trade-off between edit strength and preservation than alignment baselines, enabling more precise concept amplification and suppression with reduced drift on preservation metrics.
