Search papers, labs, and topics across Lattice.
The paper introduces EvA, an "evidence-first" architecture for Large Audio Language Models (LALMs) designed to mitigate the "evidence bottleneck" where LALMs struggle to extract and preserve task-relevant acoustic information. EvA combines Whisper and CED-Base through time-aligned fusion of intermediate CED layers, preserving multi-scale acoustic cues without altering sequence length. Evaluated under a unified zero-shot protocol, EvA achieves state-of-the-art open-source perception scores on MMAU, MMAR, and MMSU, and outperforms Kimi-Audio-7B, particularly on perception-heavy tasks, validating the importance of preserving acoustic evidence for improved audio understanding.
LALMs struggle more with *hearing* the evidence than *reasoning* about it, and EvA's evidence-first fusion architecture proves it.
Large Audio Language Models (LALMs) still struggle in complex acoustic scenes because they often fail to preserve task-relevant acoustic evidence before reasoning begins. We call this failure the evidence bottleneck: state-of-the-art systems show larger deficits in evidence extraction than in downstream reasoning, suggesting that the main limitation lies in upstream perception rather than reasoning policy. To address this problem, we propose EvA (Evidence-First Audio), a dual-path architecture that combines Whisper and CED-Base through non-compressive, time-aligned fusion. EvA first aggregates intermediate CED layers to preserve multi-scale acoustic cues, then aligns the aggregated CED features to the Whisper timeline and adds the two streams without changing sequence length. We also build EvA-Perception, a large-scale open-source training set with about 54K event-ordered captions (150 h) and about 500K QA pairs. Under a unified zero-shot protocol, EvA achieves the best open-source Perception scores on MMAU, MMAR, and MMSU, and improves over Kimi-Audio-7B on all reported metrics, with the largest gains on perception-heavy splits. These results support the evidence-first hypothesis: stronger audio understanding depends on preserving acoustic evidence before reasoning.
