Search papers, labs, and topics across Lattice.
Web2BigTable is introduced, a bi-level multi-agent LLM system designed for internet-scale information search and extraction, addressing both deep reasoning and structured aggregation challenges. It employs an upper-level orchestrator for task decomposition and lower-level worker agents for parallel execution, iteratively improving through a closed-loop run-verify-reflect process with external memory. Web2BigTable achieves state-of-the-art results on WideSearch (7.5x improvement in Avg@4 Success Rate) and strong performance on XBench-DeepSearch, demonstrating its effectiveness in both breadth and depth-oriented search tasks.
LLMs can achieve a 7.5x performance boost in web search and extraction by using a bi-level multi-agent architecture with iterative refinement and shared memory.
Agentic web search increasingly faces two distinct demands: deep reasoning over a single target, and structured aggregation across many entities and heterogeneous sources. Current systems struggle on both fronts. Breadth-oriented tasks demand schema-aligned outputs with wide coverage and cross-entity consistency, while depth-oriented tasks require coherent reasoning over long, branching search trajectories. We introduce \textbf{Web2BigTable}, a multi-agent framework for web-to-table search that supports both regimes. Web2BigTable adopts a bi-level architecture in which an upper-level orchestrator decomposes the task into sub-problems and lower-level worker agents solve them in parallel. Through a closed-loop run--verify--reflect process, the framework jointly improves decomposition and execution over time via persistent, human-readable external memory, with self-evolving updates to each single-agent. During execution, workers coordinate through a shared workspace that makes partial findings visible, allowing them to reduce redundant exploration, reconcile conflicting evidence, and adapt to emerging coverage gaps. Web2BigTable sets a new state of the art on WideSearch, reaching an Avg@4 Success Rate of \textbf{38.50} ($7.5\times$ the second best at 5.10), Row F1 of \textbf{63.53} (+25.03 over the second best), and Item F1 of \textbf{80.12} (+14.42 over the second best). It also generalises to depth-oriented search on XBench-DeepSearch, achieving 73.0 accuracy. Code is available at https://github.com/web2bigtable/web2bigtable.