Search papers, labs, and topics across Lattice.
This paper investigates the vulnerability of cross-modal encoders, like CLIP, to "hubness," where certain embeddings are spuriously close to many unrelated examples. They introduce a method to identify hub embeddings and their corresponding "hub texts" within the shared embedding space of text and images. Experiments on image captioning and retrieval tasks demonstrate that a single, carefully chosen "hub text" can achieve similarity scores comparable to or exceeding human-written captions for numerous images, highlighting a significant weakness in these encoders.
A single, optimized text snippet can fool CLIP into thinking it's a good caption for almost any image, revealing a surprising vulnerability in cross-modal understanding.
The hubness problem, in which hub embeddings are close to many unrelated examples, occurs often in high-dimensional embedding spaces and may pose a practical threat for purposes such as information retrieval and automatic evaluation metrics. In particular, since cross-modal similarity between text and images cannot be calculated by direct comparisons, such as string matching, cross-modal encoders that project different modalities into a shared space are helpful for various cross-modal applications, and thus, the existence of hubs may pose practical threats. To reveal the vulnerabilities of cross-modal encoders, we propose a method for identifying the hub embedding and its corresponding hub text. Experiments on image captioning evaluation in MSCOCO and nocaps along with image-to-text retrieval tasks in MSCOCO and Flickr30k showed that our method can identify a single hub text that unreasonably achieves comparable or higher similarity scores than human-written reference captions in many images, thereby revealing the vulnerabilities in cross-modal encoders.
