Search papers, labs, and topics across Lattice.
This paper introduces PRMU, a benchmark designed to evaluate corpus-free knowledge unlearning in multimodal large language models (MLLMs) under realistic person-centric deletion scenarios. The authors highlight the limitations of existing unlearning methods, which often rely on unavailable corpora and struggle with maintaining knowledge locality while forgetting target information. Through extensive experiments, they demonstrate that their proposed Similarity-Gated Projection Editing (SGPE) method achieves a favorable balance between effective knowledge removal and preservation of related knowledge, outperforming traditional approaches in various evaluations.
Existing unlearning methods for MLLMs can lead to significant knowledge locality degradation, while the new SGPE method strikes a competitive balance between forgetting and preserving relevant knowledge.
Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in storing and recalling rich person-related knowledge, raising increasing concerns about reliable knowledge removal. However, existing machine unlearning approaches for MLLMs typically assume access to original forget and retain corpora, which are often unavailable in realistic deletion scenarios. To address this limitation, we introduce PRMU, a benchmark for evaluating corpus-free multimodal unlearning under realistic person-centric deletion requests. PRMU focuses on naturally acquired person-related knowledge and evaluates whether models can remove target knowledge while preserving related knowledge through diverse textual and visual probes, including adversarial evaluation and fine-grained locality analysis. To facilitate research in this setting, we further introduce Similarity-Gated Projection Editing (SGPE), a lightweight corpus-free unlearning baseline with knowledge displacement, protected parameter-space editing, and locality-aware multimodal control. Extensive experiments on representative MLLMs reveal that existing unlearning methods often suffer from unfavorable forgetting-locality trade-offs, with significant locality degradation under aggressive forgetting settings, and remain vulnerable to multimodal knowledge reactivation. Meanwhile, SGPE provides a competitive trade-off between target forgetting, locality preservation, and general multimodal utility. We hope PRMU can facilitate future research toward realistic and scalable multimodal machine unlearning. Code and dataset will be released at https://github.com/2231122/PRMU.
