Search papers, labs, and topics across Lattice.
This paper introduces a probing-based framework for evaluating the disentanglement of neural audio codecs, particularly in the context of acoustic teleportation. By regressing room-acoustic parameters and classifying speaker identity, the authors reveal that while speaker identity remains well-contained within its designated partition, acoustic information inadvertently leaks into speech embeddings due to the training objectives. The findings show that acoustic embeddings can estimate room parameters with remarkable accuracy, suggesting that meaningful structure can emerge in the absence of explicit supervision.
Speaker identity is effectively isolated in acoustic teleportation codecs, but acoustic features leak into speech embeddings, challenging existing evaluation methods.
Some neural audio codecs disentangle speech into latent subspaces encoding content, speaker identity, and acoustics, enabling acoustic teleportation and voice conversion. Existing evaluations rely on cross-reconstruction quality, which cannot reliably detect leakage across partitions. We extend a probing based framework to assess disentanglement by regressing room-acoustic parameters (reverberation time, clarity, and direct-to-reverberant ratio) and classifying speaker identity, using the gap between intended and unintended partitions as the disentanglement measure. Applied to an acoustic teleportation codec, we find speaker identity is largely confined to its partition, while acoustics leak into the speech embeddings due to the training objective. Acoustic embeddings blindly estimate room parameters within 0.02 s of supervised baselines, indicating physically meaningful structure emerges without explicit supervision.
