Search papers, labs, and topics across Lattice.
This paper introduces a novel method called Output Space Redistribution (OSR) to adapt classification models for dynamic label removal without the need for retraining. By statistically redistributing output space to approximate post-removal confidence vectors, OSR overcomes the limitations of existing methods, such as high computational costs and privacy concerns. Experimental results show that OSR achieves competitive performance compared to full retraining while enhancing efficiency and preserving privacy across various classification tasks.
Bypassing retraining, OSR achieves competitive classification performance while significantly improving computational efficiency and privacy preservation.
Label removal occurs frequently in classification systems with evolving taxonomies, where categories must be dynamically updated or eliminated. To accommodate such changes, classification models must adapt accordingly. Existing solutions, broadly categorized as retraining-based and feature-space-adjustment-based, share common limitations despite their variations, including reliance on access to original data, substantial computational and storage costs, inconsistent results, poor scalability, and degradation of model utility. To address this, we propose a novel approach that leverages statistical redistribution in the output space to approximate the post-removal confidence vectors of a retrained model. Applicable as a modular output filter, our method bypasses the burden of feature-space adjustments or loss-function convergence, alleviating scalability limitations. Furthermore, by requiring only existing labels and prior output confidences, the method potentially mitigates privacy concerns inherent to data-dependent solutions. Extensive experiments demonstrate competitive performance against full retraining, with improvements in computational efficiency and privacy preservation across several classification tasks.
