Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the factors influencing citation faithfulness and coverage in a 4B parameter on-device research agent operating on a personal laptop. By analyzing the effects of source exposure and retrieval quality, the authors find that citation faithfulness is primarily determined by the amount of source content seen, improving from 0.45 to 0.58 with increased exposure, while coverage remains limited regardless of exposure due to low recall rates. The findings highlight a practical approach for optimizing citation quality by prioritizing source exposure before addressing retrieval recall.
Citation faithfulness in on-device research agents is primarily driven by how much of each source is seen, not by the quality of the sources themselves.
On-device research agents search a corpus, read sources, and write a cited brief on a personal laptop. Whether their citations are faithful, and at what cost, is unmeasured for a deployable small model. This study fixes one 4B generator on a 24 GB laptop and asks what makes its citations faithful. It separates two quantities usually reported as one number. Cited claim faithfulness asks whether the cited source supports the claim. Trustworthy coverage asks whether the agent also cites the right sources. The study crosses how much of each source the generator sees, 400 against 1500 characters, with the quality of the sources supplied, gold papers against retrieved papers. Two levers fall out, and they act on different outcomes. Exposure sets faithfulness. More of each source lifts faithfulness from 0.45 to 0.58 on retrieved sources and from 0.37 to 0.58 on gold sources, and the two settings converge, so faithfulness is bound by exposure, not by whether the source is correct. The exposure lift is robust to a second, independent judge; the exact convergence is tight under the primary judge and only approximate under the second. Retrieval sets coverage. Trustworthy coverage stays near 0.22 on retrieved sources at any exposure, because recall is held near 0.40, so exposure cannot fix which sources are cited. The extra exposure costs about 235 output tokens. The practical recipe is to raise per source exposure first, cheaply, and then treat retrieval recall as the only remaining lever.