Search papers, labs, and topics across Lattice.
This paper introduces an evidence-seeking agent designed for temporal-logic video question answering (VideoQA), which actively explores video content to reason about temporal relationships between actions. Unlike standard vision-language models that rely on fixed frame sampling, this agent employs a Think-Act-Observe loop and a multi-granular sampling toolkit to dynamically gather evidence based on the temporal context of the questions. The approach achieves a notable 77.13 AvgAcc on the TimeLogic test set, demonstrating significant improvements in handling complex temporal reasoning tasks in video content.
Active exploration in VideoQA allows for precise temporal reasoning, achieving a remarkable 77.13 AvgAcc by dynamically sampling evidence based on question context.
Temporal-logic video question answering requires a model to reason about when actions occur relative to one another, such as before, after, until, since, overlap, and multi-event chains, rather than merely what is present in a video. Standard vision-language models typically answer such questions in a single pass over a fixed, uniformly sampled set of frames, which is poorly matched to evidence that is often localized to narrow action boundaries or dispersed across several distant events. We present an evidence-seeking agent that treats temporal-logic VideoQA as active exploration. The agent follows a Think-Act-Observe loop driven by a multi-granular sampling toolkit, where every observation is interleaved with its absolute timestamp so that temporal relations reduce to numerical comparisons on a shared time axis. Its behavior is shaped by benchmark structure: a lightweight classifier routes each question to a temporal category, each with a tailored policy, iteration depth, and prompt, while sampling budgets adapt to corpus characteristics and clip length. The resulting training-free system couples Gemini 3.1 Pro with a temporal-reasoning policy and achieves 77.13 AvgAcc on the official TimeLogic test set.
