Search papers, labs, and topics across Lattice.
Audio-Mind is introduced as a framework that conditionally invokes tool use in audio agents based on the confidence of a strong audio frontend, aiming to improve audio understanding by avoiding unnecessary agentic decomposition. It dynamically combines the frontend with planner-guided tool use, acquiring external evidence only when the frontend's initial judgment is insufficient. Experiments on MMAR and MSU-Bench demonstrate that Audio-Mind outperforms existing audio-agent baselines, achieving 80.4% and 82.8% accuracy, respectively, while also producing auditable reasoning traces.
Over-reliance on agentic decomposition can actually *hurt* audio understanding when a strong audio frontend already provides sufficient information, highlighting the importance of conditional evidence acquisition.
Audio agents extend large audio-language models (LALMs) by decomposing audio questions into tool calls, intermediate evidence, and iterative reasoning steps. However, as LALMs become stronger, the key challenge shifts from enabling tool use to determining when agentic evidence acquisition genuinely benefits audio understanding. We propose Audio-Mind, an auditable and pluggable framework for conditional evidence acquisition in audio understanding. Audio-Mind dynamically combines a strong frontend with planner-guided tool use, preserving frontend judgment when initial evidence is sufficient while acquiring bounded external evidence for questions with unresolved evidence gaps. Experiments on MMAR and MSU-Bench show that Audio-Mind outperforms prior audio-agent baselines, reaching 80.4% accuracy on MMAR and 82.8% accuracy on MSU-Bench. A matched-backbone comparison highlights why this design matters: under strong audio frontends, agentic decomposition can become an orchestration bottleneck when the workflow does not preserve the frontend's holistic audio-grounded judgment. Beyond accuracy, Audio-Mind produces higher-quality, auditable reasoning traces that expose uncertainty, tool evidence, and answer rationales, offering a potential basis for more reliable audio-QA annotation and error analysis.
ETH