Search papers, labs, and topics across Lattice.
This paper formalizes the study of stochasticity in Deep Research Agents (DRAs) by modeling them as information acquisition Markov Decision Processes and introducing an evaluation framework to quantify variance across information acquisition, compression, and inference stages. Through controlled experiments, the authors identify inference and early-stage stochasticity as the primary drivers of DRA output variance. They then propose and validate mitigation strategies, including structured output and ensemble-based query generation, demonstrating a 22% reduction in average stochasticity on DeepSearchQA while maintaining research quality.
DRA outputs are surprisingly variable, with inference and early-stage decisions being the biggest culprits, but structured outputs and ensemble querying can significantly reduce this stochasticity.
Deep Research Agents (DRAs) are promising agentic systems that gather and synthesize information to support research across domains such as financial decision-making, medical analysis, and scientific discovery. Despite recent improvements in research quality (e.g., outcome accuracy when ground truth is available), DRA system design often overlooks a critical barrier to real-world deployment: stochasticity. Under identical queries, repeated executions of DRAs can exhibit substantial variability in terms of research outcome, findings, and citations. In this paper, we formalize the study of stochasticity in DRAs by modeling them as information acquisition Markov Decision Processes. We introduce an evaluation framework that quantifies variance in the system and identify three sources of it: information acquisition, information compression, and inference. Through controlled experiments, we investigate how stochasticity from these modules across different decision steps influences the variance of DRA outputs. Our results show that reducing stochasticity can improve research output quality, with inference and early-stage stochasticity contributing the most to DRA output variance. Based on these findings, we propose strategies for mitigating stochasticity while maintaining output quality via structured output and ensemble-based query generation. Our experiments on DeepSearchQA show that our proposed mitigation methods reduce average stochasticity by 22% while maintaining high research quality.
