Search papers, labs, and topics across Lattice.
This paper investigates the issue of vector hubness in retrieval-augmented generation (RAG) systems, where a few documents can disproportionately influence query results, posing a poisoning risk. By implementing admission-time control that scores candidate documents against sentinel queries, the authors effectively quarantine hub-like documents before they can impact retrieval outcomes. The proposed global gating mechanism achieves perfect recall (1.0) at critical embedding-space points and maintains robust performance against adversarial attacks, demonstrating a significant improvement over existing methods that rely on periodic scans.
Admission-time control can eliminate the poisoning risk in RAG systems, achieving perfect recall while maintaining low false positive rates.
Vector hubness, where a few points become nearest neighbors of many queries, creates a poisoning risk in retrieval-augmented generation (RAG): one injected document can influence unrelated requests. Existing defenses use periodic reverse-kNN scans, leaving an exposure window and repeated corpus-wide work. We study admission-time control, scoring each candidate against sentinel queries and quarantining hub-like documents before insertion. Across two 100,000-document corpora, five encoders, and disjoint attacker and defender query sets, a global gate achieves recall 1.0 at the decisive embedding-space point (>=0.92 across the effective range) and 0.91 +/- 0.07 on HotFlip attacks, with 1% false positives on general documents. A per-topic gate provides no reliable benefit, consistent with anisotropy coupling local and global visibility. Thresholds are maintained incrementally, with corpus-size-independent insertion cost and amortized deletion cost. On HNSW, admission adds about 3.1% to ingestion latency, scoring remains flat to 10^6 vectors, and 1.2% of decisions flip under approximate indexing, none involving attacks. Provenance complements the gate for natural or tight-domain hubs.
