Search papers, labs, and topics across Lattice.
The paper introduces Sparse Embedding Modulation (SEM), a post-hoc debiasing method for vision-language models like CLIP that leverages sparse autoencoders to disentangle bias and task-relevant information in text embeddings. SEM identifies and modulates bias-relevant neurons in the sparse latent space, allowing for targeted bias removal without sacrificing semantic fidelity. Experiments on four benchmark datasets demonstrate that SEM achieves significant fairness improvements in retrieval and zero-shot classification tasks compared to dense embedding space methods.
Unlocking fairer vision-language models may be as simple as intervening in the sparse latent space of a sparse autoencoder, enabling targeted bias removal without harming performance.
Models that bridge vision and language, such as CLIP, are key components of multimodal AI, yet their large-scale, uncurated training data introduce severe social and spurious biases. Existing post-hoc debiasing methods often operate directly in the dense CLIP embedding space, where bias and task-relevant information are highly entangled. This entanglement limits their ability to remove bias without degrading semantic fidelity. In this work, we propose Sparse Embedding Modulation (SEM), a post-hoc, zero-shot debiasing framework that operates in a Sparse Autoencoder (SAE) latent space. By decomposing CLIP text embeddings into disentangled features, SEM identifies and modulates bias-relevant neurons while preserving query-relevant ones. This enables more precise, non-linear interventions. Across four benchmark datasets and two CLIP backbones, SEM achieves substantial fairness gains in retrieval and zero-shot classification. Our results demonstrate that sparse latent representations provide an effective foundation for post-hoc debiasing of vision-language models.
