Search papers, labs, and topics across Lattice.
The paper introduces ARGOS, a new benchmark and framework for multi-camera person search formulated as an interactive reasoning problem where an agent must identify a person of interest based on a vague witness statement. The agent plans, questions, and eliminates candidates using spatial and temporal tools, grounded in a Spatio-Temporal Topology Graph (STTG) representing camera connectivity and transition times. Experiments using LLMs show the benchmark is challenging, and performance significantly degrades without domain-specific tools, highlighting the need for better reasoning and tool utilization in multi-camera tracking.
LLMs still struggle to effectively leverage spatial and temporal reasoning tools for multi-camera person search, even with explicit graph representations of camera networks and transition times.
We introduce ARGOS, the first benchmark and framework that reformulates multi-camera person search as an interactive reasoning problem requiring an agent to plan, question, and eliminate candidates under information asymmetry. An ARGOS agent receives a vague witness statement and must decide what to ask, when to invoke spatial or temporal tools, and how to interpret ambiguous responses, all within a limited turn budget. Reasoning is grounded in a Spatio-Temporal Topology Graph (STTG) encoding camera connectivity and empirically validated transition times. The benchmark comprises 2,691 tasks across 14 real-world scenarios in three progressive tracks: semantic perception (Who), spatial reasoning (Where), and temporal reasoning (When). Experiments with four LLM backbones show the benchmark is far from solved (best TWS: 0.383 on Track 2, 0.590 on Track 3), and ablations confirm that removing domain-specific tools drops accuracy by up to 49.6 percentage points.
