Search papers, labs, and topics across Lattice.
This paper surveys and analyzes the robustness of existing machine unlearning methods for Vision-Language Models (VLMs). It introduces three novel attack paradigms鈥攃ontextual prompting and downstream retraining鈥攖o reactivate supposedly forgotten multimodal knowledge. Experiments reveal that current VLM unlearning techniques are often vulnerable to these attacks, suggesting they merely mask rather than fully erase undesirable information.
Current VLM unlearning methods mostly just hide the data you want gone, and can be easily bypassed with clever prompting or retraining.
Vision-language models (VLMs) may memorize undesirable information from training data, motivating growing interest in machine unlearning. In this work, we present the first systematic survey and robustness analysis of VLM unlearning. We provide a comprehensive taxonomy and review of existing VLM unlearning methods, together with unified evaluations under multiple prompt settings. We then propose three attack paradigms to examine whether forgotten multimodal knowledge can be reactivated through contextual prompting or downstream retraining. Extensive experiments show that many existing methods remain vulnerable under these attacks, indicating that current approaches often hide rather than fully remove target knowledge. Our study provides new insights into the robustness and limitations of current VLM unlearning methods and highlights the need for more reliable multimodal unlearning strategies. Code is available at https://github.com/XMUDeepLIT/VLM-UnL-Attack.
