Search papers, labs, and topics across Lattice.
This paper introduces SHARPEN, a novel approach for repairing defects in DNNs without relying on gradient calculations. SHARPEN uses Deep SHAP to identify faulty layers and neurons by quantifying their contribution to erroneous outputs, followed by CMA-ES, a derivative-free optimization algorithm, to repair these neurons. Experiments across backdoor removal, adversarial mitigation, and unfairness repair demonstrate SHARPEN's effectiveness, outperforming baselines while preserving accuracy.
Forget retraining: SHARPEN surgically repairs defects in neural networks by pinpointing faulty neurons with explainable AI and then fixing them with gradient-free optimization.
DNNs are susceptible to defects like backdoors, adversarial attacks, and unfairness, undermining their reliability. Existing approaches mainly involve retraining, optimization, constraint-solving, or search algorithms. However, most methods rely on gradient calculations, restricting applicability to specific activation functions (e.g., ReLU), or use search algorithms with uninterpretable localization and repair. Furthermore, they often lack generalizability across multiple properties. We propose SHARPEN, integrating interpretable fault localization with a derivative-free optimization strategy. First, SHARPEN introduces a Deep SHAP-based localization strategy quantifying each layer's and neuron's marginal contribution to erroneous outputs. Specifically, a hierarchical coarse-to-fine approach reranks layers by aggregated impact, then locates faulty neurons/filters by analyzing activation divergences between property-violating and benign states. Subsequently, SHARPEN incorporates CMA-ES to repair identified neurons. CMA-ES leverages a covariance matrix to capture variable dependencies, enabling gradient-free search and coordinated adjustments across coupled neurons. By combining interpretable localization with evolutionary optimization, SHARPEN enables derivative-free repair across architectures, being less sensitive to gradient anomalies and hyperparameters. We demonstrate SHARPEN's effectiveness on three repair tasks. Balancing property repair and accuracy preservation, it outperforms baselines in backdoor removal (+10.56%), adversarial mitigation (+5.78%), and unfairness repair (+11.82%). Notably, SHARPEN handles diverse tasks, and its modular design is plug-and-play with different derivative-free optimizers, highlighting its flexibility.
Tsinghua AI