Search papers, labs, and topics across Lattice.
This paper introduces Manifold-Constrained Hyper-Connections (mHC) as an innovative approach to enhance deep speaker recognition models by reformulating residual connections into a multi-stream evolution using a doubly stochastic matrix. The method addresses the limitations of standard identity mapping, which restricts information flow, by ensuring energy conservation and stabilizing gradients through Sinkhorn-Knopp iterations. Evaluations on various architectures, including ECAPA-TDNN and ResNet-34, reveal that mHC significantly improves performance in speaker representation tasks on the VoxCeleb1 dataset, demonstrating its robustness and effectiveness.
Replacing standard residual connections with manifold-constrained hyper-connections boosts speaker recognition performance across multiple architectures.
Residual connections are fundamental to deep speaker recogni- tion models, such as ECAPA-TDNN and ResNet. However, standard identity mapping limits information flow to a sin- gle path, constraining representation capacity. We introduce Manifold-Constrained Hyper-Connections (mHC), reformulat- ing residual paths as a multi-stream evolution where informa- tion is mixed through a doubly stochastic matrix. By employing Sinkhorn-Knopp iterations, mHC ensures energy conservation by preserving signal intensity and feature mean, which stabi- lizes gradients and mitigates signal degradation in complex net- works. We evaluate mHC by replacing standard residual con- nections in backbones including ECAPA-TDNN, ResNet-34, Res2Net, and E-Res2Net. Extensive experiments on VoxCeleb1 demonstrate that mHC connections consistently enhance per- formance across all architectures, highlighting its effectiveness for robust speaker representation learning.
