Search papers, labs, and topics across Lattice.
This paper introduces X$^3$-OPD, a cross-modal on-policy distillation framework that enhances reasoning in large audio-language models by transferring knowledge from a text-based teacher model. The approach leverages a three-tier symmetric corpus that includes diverse reasoning tasks, allowing the audio-language student to generate reasoning trajectories based on its acoustic perception while receiving guidance from the teacher. Experimental results show that X$^3$-OPD significantly boosts audio-grounded reasoning and chain-of-thought quality, while maintaining the model's performance across different domains.
Bridging the reasoning gap, X$^3$-OPD enables audio-language models to outperform their text-based counterparts in logical reasoning tasks.
While large audio-language models have achieved remarkable progress in auditory perception, they still lag behind text-based large language models in deep logical reasoning, primarily due to the scarcity of high-quality audio reasoning data. To bridge this gap, we propose X$^3$-OPD, a cross-modal on-policy distillation framework that transfers reasoning capabilities from a powerful text teacher to an audio-language student. During training, the student generates reasoning trajectories conditioned on its own acoustic perception, while the teacher provides token-level guidance using matched textual inputs and verified answers. We further construct a three-tier symmetric corpus covering textual reasoning rendered into speech, audio-event reasoning grounded in complex acoustic scenes, and spoken-dialogue reasoning involving paralinguistic cues. This design extends cross-modal distillation beyond textually recoverable content to reasoning grounded in non-linguistic events, prosody, and conversational context. Experiments on MMSU, MMAU, BIG Bench Audio, and MMAR demonstrate that X$^3$-OPD substantially improves audio-grounded reasoning and chain-of-thought quality while largely preserving the model's existing capabilities under domain shift.
