Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SCAR (Semantic Continuity-Aware Retrieval), an adaptive retrieval strategy designed to mitigate boundary fragmentation in Retrieval-Augmented Generation (RAG) by selectively expanding neighboring chunks based on query-relevance and structural continuity. The method achieves a remarkable 92.8% recall on boundary-fragmented queries while reducing the average number of chunks needed from 10.16 to 7.84, representing a significant efficiency improvement. Furthermore, SCAR's effectiveness is consistent across multiple embedding models and maintains generation faithfulness, demonstrating its practical applicability in diverse contexts.
SCAR reduces token overhead by nearly 23% while achieving near-perfect recall on fragmented queries, revolutionizing context management in RAG systems.
Fixed-length chunking in Retrieval-Augmented Generation (RAG) often leads to boundary fragmentation, where critical evidence is split across segments, degrading retrieval recall. While static windowing and parent retrieval improve recall, they introduce significant token overhead. We propose SCAR (Semantic Continuity-Aware Retrieval), an adaptive retrieval policy that selectively expands neighboring chunks by weighing query-neighbor relevance against a structural continuity penalty. SCAR uses a relative expansion threshold tied to each retrieved chunk's own query-relevance, yielding an approximately scale-invariant decision rule that transfers across embedding models without recalibration. Across four diverse corpora (RFC, GDPR, a 10-K report, and a Merger agreement; N=320 queries; 160 boundary-fragmented), SCAR achieves 92.8% recall on boundary-fragmented queries with only 7.84 chunks, a 22.9% reduction compared to static windowing (10.16 chunks). Paired bootstrap tests (B=10,000) confirm the chunk reduction is highly significant (p<0.0001, Cohen's d=-1.49, large effect), with a small recall difference (Cohen's d=-0.33). The policy transfers across three embedding models (text-embedding-3-large, BGE-large-en-v1.5, zembed-1) using the same single hyperparameter setting, and downstream RAGAS evaluation on the 10-K corpus confirms SCAR preserves generation faithfulness while reducing context tokens by 27.1%.