Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a hybrid document retrieval system for retrieval-augmented generation (RAG) that utilizes hyperbolic geometry, specifically the Lorentz model, to enhance retrieval efficiency on edge devices. By projecting pretrained word embeddings into hyperbolic space and employing a two-stage retrieval pipeline that combines BM25 scoring with Lorentzian similarity, the system achieves competitive performance on multiple benchmark datasets without the need for fine-tuned neural encoders. The results demonstrate that this approach can effectively support real-time indexing and querying, making it suitable for resource-constrained environments.
Hyperbolic retrieval can achieve competitive performance on edge devices, enabling real-time document indexing and querying without heavy neural architectures.
This paper presents a hybrid document retrieval system designed for retrieval-augmented generation (RAG) that operates entirely within the Lorentz model of hyperbolic geometry. Unlike conventional dense retrievers confined to Euclidean space, this system projects pretrained word embeddings into hyperbolic space through a learned HyTE-H transformation, whose exponential volume growth suits the hierarchical organization of natural language. Documents are segmented into overlapping chunks, indexed by their Lorentz embeddings, and retrieved through a two-stage pipeline that first applies BM25 lexical scoring, then re-ranks candidates using Lorentzian inner-product similarity. A tunable parameter $α$ blends the BM25 score with the hyperbolic similarity score. The system was evaluated on five datasets from the BEIR benchmark suite, SciFact, NFCorpus, ArguAna, SciDocs, and FiQA, achieving NDCG@10 scores of 0.654, 0.304, 0.342, 0.150, and 0.217 respectively with word embeddings alone, without fine-tuned neural encoders or cross-attention rerankers. The system supports real-time indexing of user-supplied documents and resource-efficient querying over tens of thousands of moderately sized documents, so hyperbolic retrieval can run on edge devices at interactive latencies.