Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces E-SENS, a novel reranking method designed to enhance retrieval-augmented language models by addressing their inability to respect negative constraints in user queries. By extracting a compact trap query for excluded concepts and subtracting its similarity from the original query's retrieval score, E-SENS effectively mitigates the issue of high similarity scores for unwanted concepts. The method demonstrates a significant improvement in recall-violation trade-offs across four embedding models on the ExcluIR benchmark, ultimately reducing the retrieval of excluded concepts while preserving recall.
E-SENS reveals that a simple reranking approach can dramatically improve retrieval accuracy by effectively managing negative constraints in user queries.
Retrieval-augmented language models can fail to respect negative constraints when the retriever supplies evidence about concepts the user explicitly excluded. Beyond explicit negation, queries may ask for answers that include one concept while excluding another, or for entities that belong to a category but differ from a closely related instance. Because the excluded concept still appears in the query text, dense retrievers may assign high similarity to documents about that concept even when the user asks to avoid it. We introduce E-SENS, a training-free reranking method for negation-sensitive retrieval. E-SENS extracts a compact trap query for the excluded side and subtracts trap-query similarity from the original-query retrieval score. On ExcluIR, E-SENS shows a clear recall-violation trade-off across four embedding models and reduces trap retrieval at recall-preserving settings.