Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper analyzes retrieval performance in RAG systems under token erasure, modeling query representations with term-frequency features and employing TF-IDF-weighted similarity for retrieval. They derive an explicit approximation and computable upper bounds for retrieval error probability by proving the convergence of similarity margins to a multivariate Gaussian distribution. Both theoretical analysis and empirical validation on real-world data demonstrate that assigning semantically adaptive redundancy based on feature importance enhances retrieval reliability.
Protecting semantically important query features with redundancy is key to robust retrieval in RAG systems, even when tokens are erased.
This paper introduces and analyzes a search and retrieval model for RAG-like systems under {token} erasures. We provide an information-theoretic analysis of remote document retrieval when query representations are only partially preserved. The query is represented using term-frequency-based features, and semantically adaptive redundancy is assigned according to feature importance. Retrieval is performed using TF-IDF-weighted similarity. We characterize the retrieval error probability by showing that the vector of similarity margins converges to a multivariate Gaussian distribution, yielding an explicit approximation and computable upper bounds. Numerical results support the analysis, while a separate data-driven evaluation using embedding-based retrieval on real-world data shows that the same importance-aware redundancy principles extend to modern retrieval pipelines. Overall, the results show that assigning higher redundancy to semantically important query features improves retrieval reliability.