Search papers, labs, and topics across Lattice.
MonaVec introduces a training-free, embedded vector-search kernel designed for edge and offline AI systems, addressing the limitations of existing vector-search systems that rely on persistent servers and extensive resources. Utilizing a Randomized Hadamard Transform, MonaVec achieves significant quantization efficiency, reducing data size by 8x without the need for a learned codebook or training data. The system demonstrates exceptional performance, achieving 0.960 Recall@10 with a compact 27 MB footprint, surpassing traditional methods while ensuring reproducibility and determinism across different architectures.
MonaVec achieves 0.960 Recall@10 with just 27 MB of storage, outperforming traditional vector-search systems while eliminating the need for training data.
We present MonaVec, a deterministic, embedded vector-search kernel for edge and offline AI -- settings where server infrastructure, network connectivity, and training data are all unavailable. Existing vector-search systems assume a persistent server, gigabytes of RAM, or a training pass over the corpus; MonaVec instead targets the deployment profile of SQLite: one file, one function call, runs anywhere. Its quantization core is training-free by default and data-oblivious: a Randomized Hadamard Transform (RHDH) conditions any input distribution toward N(0,1), so precomputed Lloyd-Max tables quantize to 4 bits (8x smaller) with no learned codebook and no data pass. The index persists as a single .mvec file whose embedded ChaCha20 rotation seed makes results reproducible across architectures and byte-identical within a build -- a determinism guarantee that parallel-build graph libraries cannot offer. On semantic embeddings (AG News, 45K x 1024-dim BGE-M3, cosine), MonaVec 4-bit BruteForce reaches 0.960 Recall@10 in 27 MB -- leading float32 FAISS-IVF and 8-bit usearch on recall -- while trading peak throughput for byte-identical determinism. A single-pass global standardization (fit()) extends the same data-oblivious pipeline to magnitude-sensitive L2 data, and optional IvfFlat and HNSW backends carry it to million-vector corpora. MonaVec is implemented in pure Rust with Python bindings and runtime SIMD dispatch (AVX-512/AVX2/NEON/scalar). It targets on-device RAG, offline agents, and embedded retrieval -- the niche SQLite occupies for relational data: one file, one call, runs anywhere.
