Search papers, labs, and topics across Lattice.
This paper investigates the potential of using the weights of low-rank adaptation (LoRA) fine-tuned models to detect child sexual abuse material (CSAM) without generating harmful outputs. By analyzing the top-left singular vectors of LoRA updates, the authors establish a robust fingerprint that accurately identifies the training content while maintaining a low false positive rate on benign images. The findings suggest a novel approach to moderation that circumvents the limitations of traditional metadata reliance and output generation, enhancing safety in image generation tasks.
A novel method reveals that the weights of LoRA fine-tuned models can directly identify harmful training content, bypassing the need for risky output generation.
Low-rank adaptation (LoRA) fine-tuning has made it cheap and easy to customize open-weight image generation models for specific tasks, including the production of child sexual abuse material (CSAM). Existing moderation relies on metadata or generated outputs, but metadata can be deceptive and generating outputs may itself be unacceptable or illegal. We show that a safer signal lives in the weights. The top-left singular vectors of a LoRA's updates form a compact, inference-free fingerprint ($u_1$) of its strongest learned change. Using human-subject age as a benign proxy for CSAM, we find that $u_1$ identifies what a LoRA was trained on, generalizes across base models, and abstains on unrelated benign content. The signal is robust to additive weight noise, rescaling, and precision reduction. These results indicate that harmful LoRAs could be screened directly from their weights without relying on metadata or generating harmful outputs.
