Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of capability persistence in spoken language understanding (SLU) systems, where specific functionalities can inadvertently remain active even after attempts to suppress them. The authors introduce Binding Subspace (BSU), a representation-level framework that effectively isolates and attenuates the intent-conditioned directions responsible for this persistence. Experimental results demonstrate that BSU significantly decreases the recoverability of suppressed intents while maintaining overall performance on SLU benchmarks.
Capability persistence in SLU systems can be effectively mitigated, allowing for safer deployment in sensitive environments without sacrificing performance.
Modern spoken language understanding (SLU) systems are increasingly deployed in real-world settings, where specific functionalities may need to be removed due to policy or safety constraints. In SLU, a functionality corresponds to an intent and its associated slot-generation behavior. However, in autoregressive models, suppressing a target intent does not eliminate the conditional mapping that generates slots conditioned on that intent. When the intent prefix is externally supplied, the model can reconstruct the original intent-slot structure. We identify this structural failure as \textbf{\emph{capability persistence}}. We propose \textit{\underline{B}inding \underline{S}ubspace (BSU)}, a representation-level framework that isolates and attenuates intent-conditioned directions underlying this mapping. Across SLU benchmarks, BSU substantially reduces forced-prefix recoverability while preserving retained performance.