Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces HNTL, a novel vector indexing framework designed to optimize high-dimensional approximate nearest neighbor searches by eliminating pointer overhead and irregular memory access patterns. By partitioning the high-dimensional space into coherent local grains and utilizing a pointerless Block-SoA layout, HNTL achieves remarkable efficiency, capturing 96.3% variance on anisotropic manifold data. The method demonstrates a significant performance improvement, achieving a Rerank Recall@10 of 1.0000 with a candidate pool of just 20 vectors and a 3.61x speedup in processing time compared to traditional pointer-based approaches.
Achieving perfect recall with a mere 20 candidate vectors, HNTL redefines efficiency in high-dimensional nearest neighbor searches.
We present HNTL (Hierarchical No-pointer Tangent-Local), the core vector indexing and candidate generation framework of the Aperon vector memory system. Proximity graphs (e.g., HNSW) incur a heavy pointer tax in memory overhead and induce irregular memory accesses that stall CPU pipelines. HNTL resolves this by partitioning the high-dimensional space into local, coherent grains, representing vectors as low-dimensional coordinates on local tangent spaces, and scanning them sequentially using a pointerless Block-SoA (Structure-of-Arrays) layout. On anisotropic manifold data (d=768, N=10,000), local PCA captures 96.3% of the variance, allowing HNTL to achieve a final Rerank Recall@10 of 1.0000 with a candidate pool size of only C=20 vectors. Hardware profiling via Apple kperf CPU Performance Monitoring Unit (PMU) counters demonstrates a 3.61x speedup (4.137 ns/vector vs. 14.951 ns/vector) for our NEON auto-vectorized C++ Block-SoA scan engine over standard pointer-chasing graph traversals, driven by a 3.59x IPC (Instructions Per Cycle) and near-zero L1/L2 data cache misses.