Search papers, labs, and topics across Lattice.
The paper introduces ContiGuard, a continual learning framework designed to improve toxicity detection against evolving adversarial perturbations. ContiGuard uses an LLM-powered semantic enriching strategy to improve comprehension of perturbed text and a discriminability-driven feature learning strategy to focus on critical features for toxicity detection. Experiments demonstrate that ContiGuard effectively updates detection capabilities and maintains resilience against evolving perturbations, outperforming existing methods.
LLMs can help toxicity detectors stay ahead of evolving adversarial attacks by enriching perturbed text with semantic clues, enabling continual learning.
Toxicity detection mitigates the dissemination of toxic content (e.g., hateful comments, posts, and messages within online social actions) to safeguard a healthy online social environment. However, malicious users persistently develop evasive perturbations to disguise toxic content and evade detectors. Traditional detectors or methods are static over time and are inadequate in addressing these evolving evasion tactics. Thus, continual learning emerges as a logical approach to dynamically update detection ability against evolving perturbations. Nevertheless, disparities across perturbations hinder the detector's continual learning on perturbed text. More importantly, perturbation-induced noises distort semantics to degrade comprehension and also impair critical feature learning to render detection sensitive to perturbations. These amplify the challenge of continual learning against evolving perturbations. In this work, we present ContiGuard, the first framework tailored for continual learning of the detector on time-evolving perturbed text (termed continual toxicity detection) to enable the detector to continually update capability and maintain sustained resilience against evolving perturbations. Specifically, to boost the comprehension, we present an LLM-powered semantic enriching strategy, where we dynamically incorporate possible meaning and toxicity-related clues excavated by LLM into the perturbed text to improve the comprehension. To mitigate non-critical features and amplify critical ones, we propose a discriminability-driven feature learning strategy, where we strengthen discriminative features while suppressing the less-discriminative ones to shape a robust classification boundary for detection...
