Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors track prefix-by-prefix embedding trajectories across 65,444 incremental prefixes of 2,144 Vietnamese legal queries against 20,034 candidate articles using Nemotron-3-Embed and Qwen3-Embedding models. Across all architectures, retrievers lock the gold document into rank 1 after a median of just 6–7 content words, after which the trailing interrogative framing actively displaces the vector away from the target document in 95–99% of cases. In multi-question queries, retrievers display an overwhelming primacy bias, locking onto the first sub-question 94–98% of the time while leaving retrieval rank invariant to subsequent questions as trajectory step sizes decay at $i^{-0.8}$.
Dense retrievers lock onto the correct document after just six content words, rendering subsequent sub-questions virtually invisible and turning trailing interrogative phrases into counterproductive directional noise.
A dense retriever encodes a question as one vector, but the question arrives one word at a time. We read 2,144 held-out headlines from Thu Vien Phap Luat (Vietnamese legal library) word by word with Nemotron-3-Embed 8B/1B and Qwen3-Embedding 8B/0.6B, encoding 65,444 prefixes against 20,034 articles, plus every prefix of 3,438 sub-questions from 1,112 multi-question headlines and of 168 answers. (i) The gold article becomes rank 1 after a median of 6-7 content words in every encoder, before the interrogative frame is read, and stays there to the end in 78-85% of cases. (ii) In a multi-question headline the lock is inside the first sub-question 94-98% of the time; the second leaves rank unchanged in 89-95%; encoded alone, the second reaches rank 1 in 42-58% vs 91-96% for the first, at the same lock word (95-97% identical). (iii) Numbers, dates and instrument identifiers move the embedding twice as far as content words and four times as far as interrogative words; 72-78% of steps move toward the gold article, and the closing interrogative frame moves against that direction in 95-99% of headlines. (iv) Rank/cosine clustering yields six archetypes (instant, typical, unstable, late, never-locking) that differ by legal area and form (chi-squared p < 1e-8): real-estate and litigation headlines never lock on a number; environmental and accounting headlines do so a third of the time. (v) An answer read word by word retrieves its article after 8-16 words and addresses the sub-questions in order asked in 83-89% of cases. (vi) A word's step keeps a consistent direction across headlines (cosine 0.25-0.33; 0.44-0.60 for numbers); a preceding question rotates that step by about 60 degrees and a greeting by about 30 degrees; steps shrink as i^{-0.8}; and a two-question headline is within 12-17 degrees of a linear mix of its two questions. We call this a context-modulated additive walk.