Search papers, labs, and topics across Lattice.
This paper introduces GenEvA, a novel framework for long-video understanding that organizes selected frames into a query-relevant cross-frame evidence structure, enhancing the integration of complementary cues across moments. By leveraging a query-conditioned evidence distribution, GenEvA effectively aggregates latent evidence from multiple frames, improving the generation of answers while maintaining efficiency with minimal overhead. The results demonstrate significant performance improvements on four benchmarks, with notable accuracy gains of up to 10.1 points on LVBench using only a small percentage of additional video tokens.
GenEvA achieves up to 10.1 points higher accuracy in long-video understanding while using less than 0.4% additional video tokens.
Long-video understanding commonly compresses videos into a small set of frames or visual tokens for answer generation. Existing compact pipelines focus on retaining relevant visual content as explicit evidence. Yet making evidence available does not ensure that complementary cues across moments are integrated for answering. Our key idea is to organize selected frames into query-relevant cross-frame evidence before generation. We formulate this post-selection stage as a latent evidence interface and instantiate it with GenEvA ($\textbf{Gen}erative$ $Latent$ $\textbf{Ev}idence$ $\textbf{A}ggregation$), a distribution-guided latent evidence aggregation framework. Specifically, GenEvA uses a query-conditioned evidence distribution to focus aggregation on relevant frames, forming compact cross-frame latent evidence from their frame-specific information. Since cross-frame integration is not always needed, the same distribution determines whether to insert this latent complement. Across four benchmarks and two Video-MLLM backbones, GenEvA consistently improves matched-frame baselines. At 8 frames, it raises the four-benchmark LLaVA-Video average by $+5.2$ points and Qwen2.5-VL accuracy on LVBench by $+10.1$ points. These gains require only $0.11\%$--$0.40\%$ average video-token overhead; analyses further show task-aware allocation and benefits from Adaptive Evidence Invocation.
