Search papers, labs, and topics across Lattice.
This paper addresses the issue of exclusion inversion in late-interaction retrieval systems, where documents containing excluded topics are incorrectly promoted due to additive scoring methods. The authors introduce EXCISE, a query-time solution that utilizes two lightweight modules to identify excluded topics and re-embed a shortlist of candidates, significantly improving exclusion success rates and Boolean NOT accuracy across multiple datasets. Results show that EXCISE outperforms all tested fine-tuned cross-encoders while maintaining performance on frozen baselines, demonstrating its effectiveness in enhancing retrieval accuracy without compromising efficiency.
EXCISE corrects exclusion inversion in retrieval systems, boosting exclusion success rates from 5.8% to an impressive 69.1%.
Late-interaction retrievers handle exclusion queries poorly. When a user asks for X but not Z, the additive MaxSim score promotes documents covering Z, a problem we call exclusion inversion. We show that no readout of the frozen vectors recovers the constraint, because the difficulty lies in identifying the excluded topic, which depends on the query alone. EXCISE operates at query time and corrects the inversion while leaving the index frozen. Two query-side modules totalling 1.5M parameters identify the topic and re-embed a 100-document shortlist, and a parameter-free rule demotes candidates matching that topic. Across six collections and three backbones, EXCISE is the strongest system in all eighteen backbone-collection cells against that backbone's own frozen and fine-tuned baselines. It raises exclusion success@10 on ExcluIR from 0.058 to 0.691 and raises Boolean NOT accuracy from 0.25-0.29 to 0.90-0.92. Pooled over 1,860 queries, it outperforms every fine-tuned cross-encoder, each of which loses no-harm nDCG@10, whereas EXCISE matches its frozen baseline on its strongest backbone. We release X-BENCH, a tiered benchmark of explicit, implicit, and compound exclusions with no-harm and Boolean controls.
