Search papers, labs, and topics across Lattice.
This study evaluates eight chunking strategies for dense retrieval across various embedding models and corpus sizes, focusing on both retrieval effectiveness and operational costs. The findings reveal that more complex chunking methods do not consistently outperform simpler alternatives, and the optimal strategy is highly dependent on specific conditions such as the embedding model and target metrics. This multi-objective analysis highlights the importance of considering operational trade-offs in addition to retrieval performance when selecting chunking methods for real-world applications.
Simpler chunking methods often outperform complex ones, challenging the assumption that more sophisticated approaches yield better retrieval results.
Dense retrieval is commonly evaluated on benchmarks that represent each document with a single embedding, even though real-world retrieval systems often index long documents that require chunking. In these settings, the chosen chunking method not only affects retrieval quality, but also indexing throughput, query latency, and memory usage. Prior comparisons of chunking strategies have mainly focused on retrieval performance, leaving operational trade-offs underexplored. To address these issues, we evaluate eight representative chunking strategies across two scalable corpora, three embedding models, and multiple corpus sizes, measuring both retrieval effectiveness and system-level costs. Our results show that computationally expensive methods rarely provide consistent gains over simpler chunking. Instead, the best performing strategy depends on the embedding model, dataset, corpus size, and target retrieval metric. Methods with similar performance can also differ substantially in operational cost, showing that chunking should be seen as a multi-objective design decision.
