Search papers, labs, and topics across Lattice.
This paper introduces NullEdit, a novel approach that leverages vision-language models (VLMs) to stealthily suppress unauthorized image edits while maintaining the natural appearance of the output. By redirecting the VLM representation formed from the reference image and instruction, NullEdit effectively prevents harmful edits without introducing conspicuous artifacts or altering the identity of the subject. The method achieves a significant reduction in EditReward IF scores, outperforming state-of-the-art defenses while preserving content integrity across multiple datasets.
NullEdit achieves a remarkable 0.813 reduction in EditReward IF scores, effectively neutralizing harmful image edits without compromising the visual quality or identity of the original image.
Modern image editors combine vision-language models (VLMs) with diffusion transformer backbones to modify a single reference image according to instructions without fine-tuning. This capability also enables unauthorized manipulation of publicly released images. Existing inference-time defenses either invalidate edits through conspicuous corruption, thereby exposing the protection, or allow them to proceed with identity or reference content drift, thereby failing to prevent the editing behavior itself. We instead target a stealthy and harmless no-op in which the requested edit is suppressed, the output remains natural and source-preserving without conspicuous artifacts or identity replacement, and harmful semantics requested by malicious instructions are absent. We propose NullEdit, which targets the VLM representation jointly formed from the reference image and instruction before it conditions the downstream DiT backbone. Using normal-edit and no-edit anchors, NullEdit redirects this representation, while cross-prompt gradient averaging transfers protection to held out instructions. Across Step1X-Edit and Qwen-Image-Edit on CelebA-HQ and VGGFace2, NullEdit reduces the EditReward IF score by 0.813 on average relative to the SOTA baseline while preserving subject identity and source content.
