Search papers, labs, and topics across Lattice.
This paper introduces WQ-Fusion, a dual-encoder framework designed for cross-domain audio representation learning that addresses the limitations of static concatenation in pre-trained models. By employing an Adaptive Feature Modulation module and a novel element-wise gated attention mechanism, WQ-Fusion dynamically selects relevant acoustic and semantic features, enhancing the model's ability to learn universal representations. Experimental results on the Interspeech 2026 Audio Encoder Capability Challenge show that WQ-Fusion achieves a superior score of 0.836, outperforming the best single-encoder baseline significantly.
WQ-Fusion achieves a remarkable score of 0.836 in cross-domain audio representation, showcasing the power of dynamic gated attention in feature selection.
While pre-trained models excel in specialized tasks, learning universal representations across diverse acoustic domains remains challenging. To address this, we propose WQ-Fusion, a robust dual-encoder framework for cross-domain audio representation learning. Overcoming the limitations of static concatenation, WQ-Fusion integrates whisper and qwen via an Adaptive Feature Modulation module and a novel element-wise gated attention mechanism. This design enables dynamic feature selection, allowing the model to selectively emphasize relevant acoustic and semantic dimensions. Extensive experiments on the Interspeech 2026 Audio Encoder Capability Challenge (Track A) benchmark demonstrate that by effectively routing heterogeneous information, WQ-Fusion achieves a superior overall score of 0.836, significantly outperforming the strongest single-encoder baseline.
