Search papers, labs, and topics across Lattice.
This paper introduces RIVET, a training framework that leverages idempotency to enhance the robustness of voice attribute editing models against noisy label annotations. By enforcing an idempotent operator, the framework effectively reduces the sensitivity of conditional generative models to mislabeled data, leading to more stable and reliable edits. Experiments demonstrate that RIVET not only improves editing success rates but also better preserves speaker identity compared to traditional training methods.
Idempotency in training voice attribute editing models can drastically reduce the impact of noisy labels, leading to more reliable and consistent edits.
Voice attribute editing models modify characteristics such as age and gender while preserving speaker identity. In large-scale speech datasets, however, attribute annotations are often noisy or inconsistent, which can cause conditional generative models to produce unstable edits. In this work, we show that idempotency provides an effective mechanism for improving robustness to noisy labels. An idempotent operator is one for which repeated application does not change the result, i.e., f(f(x)) = f(x). Enforcing this property acts as an implicit regularizer that reduces sensitivity to mislabeled examples. We introduce RIVET, a training framework that incorporates an idempotency objective to improve robustness to label noise. We evaluate RIVET under controlled label noise and on the GLOBE dataset with naturally noisy annotations. RIVET improves editing success and better preserves speaker identity than standard training, showing that idempotency improves robustness in voice editing models.
CMU ML