Search papers, labs, and topics across Lattice.
This paper introduces VESTA, a novel long-video agent that employs a policy-steered multi-strategy retrieval mechanism to enhance evidence acquisition for complex queries. By utilizing an intent router to determine the most effective evidence-acquisition strategy鈥攚hether focused, recall, or contrastive鈥擵ESTA allows for more nuanced exploration and verification of information. The results show that VESTA significantly outperforms existing models, achieving an average accuracy improvement of 2.7 points on Video-MME-v2 and notable gains across multiple benchmarks, indicating its effectiveness in handling diverse evidence requirements.
VESTA's policy-steered retrieval approach enables long-video agents to adaptively acquire and verify evidence, leading to substantial accuracy improvements over traditional methods.
Existing long-video agents acquire evidence through one uniform behavior, ignoring whether the required evidence is concentrated, requires broad occurrence coverage, or must discriminate competing hypotheses---which can cause failure before substantive reasoning begins. Prescribing a fine-grained solution procedure for every question is not a satisfactory remedy, as it restricts autonomous exploration. We propose VESTA, a training-free long-video agent organized as a route-conditioned acquire--verify--consolidate loop. Before exploration, an intent router infers an evidence-acquisition policy---focused, recall, or contrastive retrieval over a shared visual--speech scene index---together with an evidence-accounting policy that configures the evidence view maintained during exploration. Policy-steered retrieval yields provisional references that multimodal evidence operations convert into observations, while the Reasoner remains free to verify them, re-query using intermediate findings, or inspect regions outside the retrieved set. A temporal evidence ledger consolidates observations into an adaptive, compressed view of temporal location, provenance, coverage, conflicts, verification outcomes, and hypothesis support, exposing missing and unresolved evidence to guide subsequent acquisition; finalization prioritizes verified observations. On Video-MME-v2, VESTA improves average accuracy by 2.7 points over VideoARM and gains across all six reported metrics. On LongVideoBench, EgoSchema, and LVBench under shared query-time models, it improves by 6.9 points on the LongVideoBench long subset and 1.5 on LVBench, and matches VideoARM on EgoSchema.
