Search papers, labs, and topics across Lattice.
This paper addresses the challenge of managing toxic content in text-to-audio retrieval systems by introducing a post hoc causal debiasing framework that utilizes a sentiment-controlled mediator. The proposed methods, Forgive and Forget, effectively reduce harmful audio retrievals while maintaining semantic relevance and retrieval accuracy. Experimental results demonstrate a significant reduction in toxicity with minimal impact on performance, highlighting the framework's potential for enhancing safety in audio systems.
Toxic audio retrieval can be effectively mitigated without sacrificing accuracy, thanks to a novel debiasing framework that preserves context and intent.
Handling toxic retrieval in text-to-audio systems is challenging due to contextual dependencies. Existing strategies (e.g., rephrasing, summarization) risk altering intent or omitting details. We propose a post hoc causal debiasing framework with a sentiment-controlled mediator to preserve semantic relevance while suppressing harmful speech. Our approach is model-agnostic and integrates seamlessly with existing retrieval pipelines. We introduce two variants: Forgive, which re-ranks and filters toxic audio via logit adjustment, and Forget, which generates counterfactual toxic prompts to mitigate harmful retrievals. Experiments show consistent toxicity reduction with minimal loss in retrieval accuracy, improving both safety and reliability.
