Search papers, labs, and topics across Lattice.
The paper introduces HalluAudio, a large-scale benchmark with over 5K QA pairs, to evaluate hallucination in Large Audio-Language Models (LALMs) across speech, environmental sound, and music. The benchmark employs adversarial prompts and mixed-audio conditions to systematically induce hallucinations, and evaluates models beyond accuracy using metrics like hallucination rate and error-type analysis. Benchmarking a range of models reveals significant deficiencies in acoustic grounding, temporal reasoning, and music attribute understanding, highlighting the need for more robust LALMs.
LALMs struggle to ground their responses in audio, exhibiting surprising failures in temporal reasoning and music understanding that HalluAudio exposes.
Large Audio-Language Models (LALMs) have recently achieved strong performance across various audio-centric tasks. However, hallucination, where models generate responses that are semantically incorrect or acoustically unsupported, remains largely underexplored in the audio domain. Existing hallucination benchmarks mainly focus on text or vision, while the few audio-oriented studies are limited in scale, modality coverage, and diagnostic depth. We therefore introduce HalluAudio, the first large-scale benchmark for evaluating hallucinations across speech, environmental sound, and music. HalluAudio comprises over 5K human-verified QA pairs and spans diverse task types, including binary judgments, multi-choice reasoning, attribute verification, and open-ended QA. To systematically induce hallucinations, we design adversarial prompts and mixed-audio conditions. Beyond accuracy, our evaluation protocol measures hallucination rate, yes/no bias, error-type analysis, and refusal rate, enabling a fine-grained analysis of LALM failure modes. We benchmark a broad range of open-source and proprietary models, providing the first large-scale comparison across speech, sound, and music. Our results reveal significant deficiencies in acoustic grounding, temporal reasoning, and music attribute understanding, underscoring the need for reliable and robust LALMs.
