Search papers, labs, and topics across Lattice.
This paper introduces the Hypergraph Embedding Index (HEI), a novel framework for dense vector retrieval that organizes documents based on combinations of highly activated latent embedding dimensions rather than treating embeddings as singular points. By enabling inverted-index style candidate generation while maintaining semantic ranking, HEI significantly enhances retrieval coverage without the combinatorial complexity of traditional high-dimensional approaches. The authors also identify "activation diversity" as a key metric influencing the efficiency of coordinate-inverted indexing, providing insights into the statistical properties of embedding activations.
Organizing embeddings by activation patterns rather than treating them as fixed points can dramatically enhance retrieval efficiency and coverage in dense vector search.
Dense vector retrieval has become the foundation of modern semantic search, yet existing approximate nearest neighbor (ANN) indexes treat an embedding as an indivisible point in a high-dimensional space. In this work, we propose the Hypergraph Embedding Index (HEI), a framework that instead organizes documents according to combinations of highly activated latent embedding dimensions. This formulation enables inverted-index style candidate generation while preserving the semantic ranking capabilities of dense embeddings. We further demonstrate that constructing multiple complementary hypergraphs substantially improves retrieval coverage without the combinatorial growth associated with increasing the dimensionality of a single hypergraph. Finally, we establish that the statistical properties of embedding activations strongly influence coordinate-inverted indexing efficiency, introducing \emph{activation diversity} as a diagnostic metric governing embedding indexability in coordinate-inverted frameworks.
