Search papers, labs, and topics across Lattice.
This paper introduces Audio-Zero, a novel label-free self-evolution framework designed to enhance fine-grained audio reasoning in Large Audio Language Models (LALMs). By leveraging an auditory self-play game constructed from unlabeled audio contrast pairs, the model generates clues about audio events and identifies inconsistencies to improve reasoning without relying on external labels. Experimental results demonstrate that Audio-Zero significantly enhances fine-grained auditory perception while maintaining overall audio understanding across various benchmarks.
Audio-Zero reveals that fine-grained auditory reasoning can be achieved without any external labels, transforming how we approach audio model training.
Large Audio Language models (LALMs) have made rapid progress on acoustic understanding, yet they still struggle with fine-grained audio reasoning (e.g., recognizing event order, repetitions and duration). Existing post-training methods heavily rely on expensive external labels or provide only coarse semantic signals. To bridge this gap, we introduce Audio-Zero, the first label-free self-evolution framework in the field of LALMs that improves fine-grained auditory perception and reasoning. Audio-Zero constructs an auditory self-play game from unlabeled audio contrast pairs: most players hear a reference audio, while one odd listener hears a subtle variant. The model first generates clues describing what it hears and then identifies the odd listener by reasoning over inconsistencies among clues. Since the odd listener is known by construction, the game provides verifiable rewards without any annotated answers. Experiments with Qwen2-Audio-7B-Instruct and Qwen2.5-Omni-7B on TREA, MMAU Test-mini and MMAR show that Audio-Zero improves fine-grained audio reasoning while preserving broad audio understanding. Evolutionary and diagnostic analyses further reveal that increasingly fine-grained auditory descriptions emerge naturally from game pressure.
